-- Logs begin at Tue 2022-08-09 11:39:42 UTC, end at Tue 2022-08-09 13:13:27 UTC. -- Aug 09 12:13:47.381461 dv-cinder-852369-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 12:13:47.389358 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 12:13:47 2022] *** Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: nodename: dv-cinder-852369-1-iscsi Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: machine: x86_64 Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: clock source: unix Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: pcre jit disabled Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: detected number of CPU cores: 4 Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: current working directory: / Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: detected binary path: /usr/bin/uwsgi-core Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: your processes number limit is 47680 Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: your memory page size is 4096 bytes Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: detected max file descriptor number: 2048 Aug 09 12:13:47.391321 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: lock engine: pthread robust mutexes Aug 09 12:13:47.392251 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: thunder lock: enabled Aug 09 12:13:47.392251 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 12:13:47.392251 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 12:13:47.432128 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: Python main interpreter initialized at 0x563814cf09c0 Aug 09 12:13:47.432128 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: python threads support enabled Aug 09 12:13:47.432128 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: your server socket listen backlog is limited to 100 connections Aug 09 12:13:47.432128 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: your mercy for graceful operations on workers is 90 seconds Aug 09 12:13:47.432593 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 12:13:47.432593 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: *** Operational MODE: preforking *** Aug 09 12:13:47.432875 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: *** uWSGI is running in multiple interpreter mode *** Aug 09 12:13:47.432875 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: spawned uWSGI master process (pid: 103155) Aug 09 12:13:47.433093 dv-cinder-852369-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 12:13:47.434128 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: spawned uWSGI worker 1 (pid: 103156, cores: 1) Aug 09 12:13:47.434128 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: spawned uWSGI worker 2 (pid: 103157, cores: 1) Aug 09 12:13:47.434128 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 12:13:48.082644 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 12:13:48.083265 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 12:13:49.146495 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:13:49.146495 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: from cryptography.utils import int_from_bytes Aug 09 12:13:49.147195 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:13:49.147195 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: from cryptography.utils import int_from_bytes Aug 09 12:13:49.147600 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:13:49.147600 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: from cryptography.utils import int_from_bytes Aug 09 12:13:49.147741 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:13:49.147741 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: from cryptography.utils import int_from_bytes Aug 09 12:13:51.602479 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 12:13:51.603079 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 12:13:51.603451 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 12:13:51.603544 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 12:13:51.603624 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 12:13:51.603694 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 12:13:51.603769 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 12:13:51.603844 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 12:13:51.603911 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 12:13:51.603977 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 12:13:51.604163 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.604337 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.604541 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.604850 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.605170 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.605302 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.605520 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.605667 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.605830 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.605958 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.606114 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.606206 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.606461 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.606607 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.606824 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.606970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.607069 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.607151 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.607339 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.607471 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.607644 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852369-1-iscsi {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.607738 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.607953 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.608062 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.608256 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.608346 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852369-1-iscsi {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.608612 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.608764 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.608918 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.609018 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.609219 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.609311 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.609535 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.609634 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.609835 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.609936 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.610152 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.610345 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.610511 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.610801 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.611108 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.611265 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.611421 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.611558 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.611886 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.611993 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.612130 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.612215 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.612295 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.612544 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.612651 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.612857 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.612948 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.613166 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.613258 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.613473 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.613596 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.613780 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.613932 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852369-1-iscsi {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.614101 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.614251 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.614409 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.614562 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.614812 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852369-1-iscsi {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.614914 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.615127 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.615270 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.615439 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.615582 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.615750 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.615890 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.616161 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.616260 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.616496 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.616601 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.616808 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.616903 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.617126 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.617220 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.617447 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.617543 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.617754 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.617847 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.618070 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.618164 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.618372 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.618479 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.618678 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.618773 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.618996 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.619127 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.619283 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.619383 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.619585 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.619670 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.619884 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.619979 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.620132 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.620219 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.620459 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.620564 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.620779 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.620879 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.621031 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.621118 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.621338 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.621424 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.621636 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.621732 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.621884 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.621973 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.622200 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.622289 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.622507 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.622601 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.622754 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.622849 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.623074 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.623161 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.623391 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.623493 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.623694 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.623787 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.623999 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.624086 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.624304 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.624424 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.624629 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.624726 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.624935 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.625030 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.625238 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.625324 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.625543 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.625639 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.625848 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.626023 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.626203 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.626291 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.626520 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.626608 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.626842 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.627034 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.627150 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.627245 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.627453 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.627559 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.627793 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.627899 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.628089 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.628183 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.628430 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.628535 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.628731 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.628827 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.629050 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.629145 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.629355 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.629443 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.629654 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.629749 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.629960 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.630054 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.630271 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.630363 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.630592 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.630718 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.630895 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.631005 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.631131 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.631223 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.631429 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.631525 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.631731 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.631825 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.632043 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.632129 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.632344 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.632476 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.632675 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.632761 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.632980 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.633066 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.633277 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.633364 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.633581 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.633666 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.633883 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.633971 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.634178 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.634277 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.634481 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.634575 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.634782 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.634876 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.635080 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.635173 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.635382 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.635468 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.635683 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.635777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.635982 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.636081 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.636286 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.636468 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.636616 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.636713 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.636917 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.637014 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.637220 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.637306 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.637524 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.637621 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.638160 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.638253 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.638463 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.638549 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.638768 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.638865 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.639069 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.639156 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.639386 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.639480 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.639686 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.639779 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.639988 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.640089 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.640303 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.640434 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.640641 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.640765 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.640947 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.641048 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.641262 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.641359 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.641577 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.641683 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.641885 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.642033 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.642207 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.642311 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.642503 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.642598 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.642804 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.642898 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.643102 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.643196 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.643405 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.643494 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.643702 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.643789 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.644000 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.644089 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.644292 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.644432 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.644614 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.644702 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.644908 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.644995 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.645222 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.645310 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.645505 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.645601 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.645801 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.645897 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.646107 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.646200 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.646408 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.646496 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.646714 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.646812 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.647019 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.647106 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.647325 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.647412 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.647640 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:13:51.647737 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.647970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.648064 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.648296 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.648439 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.648650 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.648748 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.648962 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.649049 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.649270 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.649358 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.649582 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.649673 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.649906 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.649994 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.650212 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.650299 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.650520 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.650606 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.650829 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.650929 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.651137 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.651231 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.651447 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.651537 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.651758 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.651852 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.652070 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.652172 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.652420 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.652513 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.652721 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.652817 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.653029 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.653116 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.653339 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.653426 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.653659 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.653748 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.653969 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.654068 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.654274 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.654360 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.654596 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.654684 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.654916 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.655017 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.655224 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.655324 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.655543 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.655629 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.655861 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.655960 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.656170 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.656258 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.656517 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.656609 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.656828 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.656930 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.657142 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.657267 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.657503 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.657591 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.657812 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.657902 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.658134 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.658231 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.658443 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.658528 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.658755 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.658843 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.659062 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.659150 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.659373 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.659466 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.659683 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.659777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.660015 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.660111 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.660325 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.660450 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.660660 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.660747 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.660973 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.661071 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.661284 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.661371 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.661593 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.661681 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.661899 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.661986 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.662207 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.662308 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.662507 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.662612 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.662807 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.662903 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.663108 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.663203 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.663407 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.663493 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.663704 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.663790 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.664004 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.664137 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.664311 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.664439 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.664644 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.664739 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.664959 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.665056 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.665259 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.665345 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.665563 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.665672 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.665870 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.665967 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.666173 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.666261 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.666471 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.666565 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.666775 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.666873 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.667079 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.667173 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.667379 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.667465 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.667690 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.667779 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.667992 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.668078 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.668292 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.668398 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.668637 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.668735 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.668940 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.669025 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.669239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.669334 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.669547 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.669669 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.669848 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.669934 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.670148 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.670281 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.670453 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.670547 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.670757 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.670844 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.671067 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.671175 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.671370 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.671457 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.671676 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.671764 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.671995 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.672092 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.672305 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.672439 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.672632 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.672719 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.672991 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.673081 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.673326 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.673436 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.673620 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.673708 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.673918 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.674005 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.674224 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.674313 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.674525 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.674612 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.674825 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.674924 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.675125 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.675213 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.675424 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.675510 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.675723 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.675810 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.676019 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.676112 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.676313 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.676503 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.676643 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.676774 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.676941 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.677026 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.677237 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.677337 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.677537 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.677632 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.677835 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.677921 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.678134 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.678234 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.678432 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.678519 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.678730 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.678816 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.679030 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.679126 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.679331 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.679418 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.679670 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.679803 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.679995 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.680082 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.680311 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.680426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.680645 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.680734 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.680954 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.681043 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.681262 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.681352 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.681570 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.681665 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.681879 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.681968 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.682188 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.682275 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.682504 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.682598 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.682811 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.682900 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.683119 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.683205 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.683427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.683522 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.683747 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.683835 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.684056 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.684152 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.684372 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.684501 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.684691 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.684779 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.684999 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.685087 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.685331 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.685431 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.685653 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.685748 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.685964 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.686049 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.686280 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.686376 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.686588 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.686675 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.686896 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.686983 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.687201 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.687296 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.687509 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.687595 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.687815 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.687911 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.688118 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.688213 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.688502 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.688610 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.688819 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.688912 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.689152 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.689245 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.689435 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.689522 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.689742 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.689833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.690097 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.690199 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.690409 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.690498 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.690709 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.690796 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.691015 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.691103 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.691327 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.691421 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.691626 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.691722 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.691934 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.692023 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.692244 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.692330 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.692584 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.692684 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.692892 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.692979 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.693200 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.693286 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.693506 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.693602 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.693807 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.693894 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.694106 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.694193 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.694415 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.694510 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.694716 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.694804 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.695016 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.695109 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.695317 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.695417 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.695616 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.695711 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.695925 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.696012 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.696230 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.696325 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.696550 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.696640 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.696851 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.696979 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.697159 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.697249 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.697474 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.697562 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.697772 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.697859 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.698081 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.698170 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.698395 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.698490 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.698694 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.698782 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.698993 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.699081 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.699309 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.699394 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.699614 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.699717 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.699911 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.700047 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.700208 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.700316 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.700531 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.700634 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.700837 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.700924 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.701139 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.701234 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.701439 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.701543 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.701746 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.701832 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.702061 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.702148 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.702359 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.702454 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.702665 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.702752 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.702969 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.703063 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.703303 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.703407 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.703581 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.704243 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.704338 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.704338 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.704516 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.704589 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.704667 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.704837 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.704934 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.705145 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.705311 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.705452 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.705541 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.705768 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.705855 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.706075 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.706171 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.706384 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.706471 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.706689 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.706776 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.706988 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.707125 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.707291 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.707379 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.707600 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.707693 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.707910 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.708165 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.708268 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.708519 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.708627 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.708833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.708934 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.709146 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.709397 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.709483 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.709731 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.709817 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.710049 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.710137 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.710368 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.710455 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.710691 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.710796 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.710994 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.711091 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.711300 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.711388 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.711602 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.711696 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.711900 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.711988 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.712206 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.712303 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.712532 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.712621 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.712835 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.712935 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.713140 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.713228 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.713445 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.713531 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.713742 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.713841 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.714042 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.714127 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.714338 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.714424 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.714636 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.714731 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.714936 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.715021 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.715233 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.715331 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.715530 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.715625 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.715826 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.715912 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.716137 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.716223 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.716460 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.716561 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.716761 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.716860 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.717058 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.717184 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.717358 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.717447 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.717670 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.717755 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.717971 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.718067 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.718270 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.718359 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.718569 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.718657 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.718907 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.718994 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.719211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.719306 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.719510 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.719596 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.719904 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.719994 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.720245 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.720334 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.720574 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.720663 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.720876 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.720976 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.721198 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.721290 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.721501 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.721633 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.721804 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.721900 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.722102 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.722197 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.722407 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.722493 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.722710 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.722804 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.723009 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.723096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.723306 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.723400 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.723612 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.723708 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.723911 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.724007 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.724213 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.724299 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.724537 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.724625 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.724840 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.724936 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.725136 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.725222 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.725438 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.725533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.725739 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.725824 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.726035 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.726136 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.726336 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.726423 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.726632 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.726717 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.726934 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.727020 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.727233 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.727319 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.727547 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.727644 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.727830 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.727939 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.728132 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.728219 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.728453 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.728554 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.728755 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.728921 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.729053 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.729141 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.729360 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.729455 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.729657 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.729747 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.729955 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.730049 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.730257 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.730343 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.730558 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.730652 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.730856 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.730941 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.731155 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.731243 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.731457 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.731546 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.731755 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.731851 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.732051 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.732144 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.732352 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.732487 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.732674 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.732760 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.732973 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.733060 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.733275 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.733364 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.733577 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.733663 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.733871 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.733957 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.734168 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.734256 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.734464 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.734561 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.734761 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.734861 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.735056 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.735142 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.735375 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.735466 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.735674 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.735867 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.735975 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.736278 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.736363 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.736610 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.736702 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.736915 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.737005 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.737217 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.737305 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.737518 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.737623 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.737817 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.737906 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.738156 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.738243 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.738458 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.738555 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.738779 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.738865 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.739095 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.739183 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.739405 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.739500 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.739717 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.739850 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.740021 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.740110 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.740332 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.740493 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.740670 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.740758 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.740974 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.741060 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.741274 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.741369 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.741579 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.741665 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.741889 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.741985 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.742190 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.742279 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.742492 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.742581 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.742808 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.742903 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.743118 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.743206 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.743426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.743513 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.743730 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.743816 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.744036 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.744165 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.744344 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.744476 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.744671 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.744756 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.744972 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.745067 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.745278 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.745365 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.745581 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.745667 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.745887 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.745976 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.746194 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.746279 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.746502 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.746598 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.746809 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.746896 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.747110 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.747197 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.747415 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.747510 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.747723 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.747809 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.748022 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.748109 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.748339 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.748459 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.748670 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.748764 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.748970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.749065 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.749272 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.749359 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.749574 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.749660 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.749873 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.749967 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.750170 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.750257 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.750469 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.750592 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.750776 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.750899 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.751141 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.751434 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.751616 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.751798 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.751941 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.752111 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.752209 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.752447 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.752540 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.752765 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.752852 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.753072 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.753171 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.753370 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.753455 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.753681 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.753775 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.753981 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.754090 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.754396 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.754493 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.754702 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.754788 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.755004 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.755092 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.755303 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.755390 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.755600 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.755685 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.755898 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.755995 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.756208 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.756294 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.756530 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.756618 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.756832 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.756921 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.757129 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.757215 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.757429 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.757597 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.757741 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.757827 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.758038 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.758159 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.758352 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.758469 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.758767 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.758854 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.759072 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.759159 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.759373 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.759476 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.759761 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.759848 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.760080 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.760175 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.760430 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.760522 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.760741 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.760829 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.761042 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.761128 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.761352 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.761462 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.761656 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.761754 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.761973 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.762060 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.762277 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.762374 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.762589 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.762676 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.763246 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.763335 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.763546 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.763632 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.763855 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.763943 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.764156 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.764245 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.764502 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.764601 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.764819 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.764915 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.765130 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.765224 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.765446 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.765542 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.765832 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.765928 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.766148 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.766236 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.766459 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.766581 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.766830 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.766934 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.767138 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.767226 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.767438 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.767539 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.767737 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.767841 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.768041 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.768130 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.768342 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.768628 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.768728 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.768811 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.768977 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.769065 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.769279 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.769367 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.769588 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.769676 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.769895 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.769990 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.770198 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.770285 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.770494 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.770580 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.770794 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.770881 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.771109 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.771198 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.771407 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.771494 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.771722 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.771808 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.772028 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.772123 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.772327 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.772431 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.772669 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.772758 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.772970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.773057 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.773276 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.773362 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.773578 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.773673 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.773876 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.773963 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.774176 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.774264 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.774477 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.774577 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.774796 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.774882 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.775103 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.775231 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.775418 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.775519 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.775725 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.775813 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.776053 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.776141 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.776358 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.776478 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.776699 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.776794 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.777011 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.777098 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.777324 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.777419 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.777622 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.777708 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.777921 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.778017 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.778224 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.778321 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.778519 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.778607 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.778815 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.778908 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.779113 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.779209 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.779411 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.779497 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.779707 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.779801 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.780004 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.780091 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.780300 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.780406 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.780625 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.780723 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.780924 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.781012 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.781235 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.781321 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.781534 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.781630 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.781832 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.781926 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.782130 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.782258 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.782530 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.782631 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.782926 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.783013 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.783228 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.783323 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.783568 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.783660 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.783868 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.783955 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.784191 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.784286 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.784521 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.784623 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.784839 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.784925 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.785152 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.785248 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.785463 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.785566 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.785772 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.785859 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.786086 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.786172 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.786396 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.786484 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.786699 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.786786 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.787009 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.787104 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.787313 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.787400 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.787621 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.787707 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.787931 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.788139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.788247 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.788496 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.788788 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.788876 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.789112 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.789210 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.789420 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.789507 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.789729 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.789823 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.790037 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.790132 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.790345 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.790431 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.790651 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.790737 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.790957 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.791044 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.791261 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.791348 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.791565 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.791651 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.791873 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.791961 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.792195 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.792323 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.792608 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.792710 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.792922 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.793009 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.793239 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.793325 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.793550 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.793646 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.793860 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.793947 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.794169 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.794256 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.794481 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.794577 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.794805 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.794899 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.795115 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.795205 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.795429 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.795516 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.795735 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.795821 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.796042 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.796135 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.796351 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.796501 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.796685 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.796775 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.796994 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.797157 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.797300 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.797387 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.797608 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.797694 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.798034 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.798131 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.798569 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.798657 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.798902 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.799087 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.799220 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.799522 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.799612 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.799851 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.799939 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.800169 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.800313 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.800505 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.800594 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.800823 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.800911 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.801142 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.801342 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.801656 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.801744 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.801969 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.802064 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.802291 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.802431 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.802612 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.802701 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.802928 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.803015 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.803241 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.803336 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.803556 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.803650 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.803858 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.803944 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.804160 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.804248 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.804482 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.804573 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.804791 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.804885 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.805092 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.805181 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.805391 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.805487 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.805707 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.805809 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.806008 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.806096 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.806312 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.806398 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.806615 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.806702 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.806919 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.807144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.807448 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.807535 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.807794 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.807899 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.808110 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.808203 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.808460 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.808550 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.808782 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.808881 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.809092 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.809179 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.809395 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.809482 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.809710 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.809815 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.810014 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.810102 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.810317 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.810405 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.810622 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.810717 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.810923 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.811019 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.811221 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.811308 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.811524 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.811613 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.811829 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.811917 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.812126 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.812213 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.812447 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.812538 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.812753 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.812839 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.813051 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.813138 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.813372 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.813500 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.813723 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.813875 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.814144 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.814231 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.814451 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.814540 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.814764 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.814899 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.815070 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.815171 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.815371 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.815458 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.815673 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.815760 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.815975 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.816070 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.816274 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.816360 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.816603 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.816690 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.816906 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.817004 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.817207 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.817295 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.817508 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.817595 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.817809 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.817908 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.818112 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.818242 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.818411 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.818506 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.818724 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.818819 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.819025 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.819111 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.819368 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.819463 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.819675 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.819763 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.819984 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.820070 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.820294 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.820413 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.820627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.820716 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.820935 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.821022 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.821272 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.821357 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.821583 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.821798 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.822112 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.822202 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.822436 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.822530 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.822754 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.822849 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.823081 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.823167 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.823392 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.823489 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.823694 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.823782 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.823994 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.824089 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.824299 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.824452 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.824636 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.824722 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.824945 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.825034 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.825254 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.825350 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.825564 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.825652 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.825870 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.825965 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.826176 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.826264 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.826483 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.826571 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.826791 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.826878 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.827098 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.827187 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.827402 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.827489 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.827716 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.827831 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.828009 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.828102 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.828310 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.828426 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.828640 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.828739 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.828943 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.829049 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.829341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.829470 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.829671 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.829768 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.829987 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.830161 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.830300 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.830479 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.830614 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.830796 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.830930 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.831108 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.831240 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.831418 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.831547 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.831725 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.831850 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.832030 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.832153 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.832342 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.832572 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.832689 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.832902 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.832992 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.833216 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.833304 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.833519 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.833699 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.833937 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.834033 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.834249 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.834351 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.834563 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.834651 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.834880 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.834968 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.835188 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.835293 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.835506 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.835601 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.835811 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.835898 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.836125 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.836222 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.836455 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.836546 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.836764 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.836851 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.837091 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.837181 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.837413 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.837508 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.837735 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.837823 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.838039 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.838134 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.838341 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.838435 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.838641 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.838727 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.838942 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.839030 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.839247 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.839336 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.839549 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.839643 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.839848 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.839979 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.840147 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.840235 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.840475 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.840628 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.840779 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.840866 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.841077 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.841163 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.841374 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.841475 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.841675 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.841772 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.841973 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.842059 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.842267 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.842367 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.842563 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.842657 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.842861 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.842958 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.843156 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.843243 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.843452 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.843538 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.843749 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.843836 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.844045 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.844132 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.844343 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.844458 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.844683 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.844773 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.844989 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.845077 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.845290 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.845394 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.845586 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.845696 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.845914 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.846011 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.846242 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.846329 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.846553 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.846649 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.846871 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.846958 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.847181 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.847270 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.847495 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.847591 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.847801 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.847888 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.848118 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.848204 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.848458 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.848560 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.848770 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.848863 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.849075 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.849162 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.849378 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.849477 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.849695 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.849782 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.849999 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.850140 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.850305 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.850401 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.850609 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.850705 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.850911 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.850997 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.851215 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.851302 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.851519 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.851606 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.851839 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.851927 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.852138 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.852225 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.852472 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.852607 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.852788 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.852882 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.853101 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.853188 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.853415 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.853501 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.853725 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.853820 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.854032 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.854119 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.854344 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.854430 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.854654 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.854750 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.854962 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.855049 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.855266 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.855352 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.855572 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.855660 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.855882 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.855970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.856187 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.856273 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.856517 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.856609 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.856827 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.856915 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.857139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.857225 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.857450 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.857547 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.857770 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.857857 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.858077 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.858164 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.858381 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.858469 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.858705 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.858808 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.859022 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.859118 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.859342 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.859428 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.859663 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.859757 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.859995 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.860089 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.860327 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.860440 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.860682 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.860892 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.860980 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.861212 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 12:13:51.861301 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.861517 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:13:51.861759 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 12:13:52.017406 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO dbcounter [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Registered counter for database nova_api Aug 09 12:13:52.018617 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO dbcounter [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Registered counter for database nova_api Aug 09 12:13:52.038194 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:13:52.040033 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_db.sqlalchemy.engines [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:13:52.045000 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writer thread running {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:13:52.046815 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writer thread running {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:13:52.101135 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.context [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1582868-d229-4f3b-a98b-d87c6e368c3b(cell1) {{(pid=103157) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 12:13:52.102280 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.context [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1582868-d229-4f3b-a98b-d87c6e368c3b(cell1) {{(pid=103156) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 12:13:52.105053 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:13:52.105463 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:13:52.106125 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_concurrency.lockutils [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:13:52.106640 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_concurrency.lockutils [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:13:52.107035 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:13:52.107754 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:13:52.108193 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:13:52.108327 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_concurrency.lockutils [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:13:52.109052 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_concurrency.lockutils [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:13:52.109505 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_concurrency.lockutils [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:13:52.110196 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:13:52.111621 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_concurrency.lockutils [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:13:52.112448 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO dbcounter [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Registered counter for database nova_cell0 Aug 09 12:13:52.113704 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO dbcounter [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Registered counter for database nova_cell0 Aug 09 12:13:52.117852 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO dbcounter [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Registered counter for database nova_cell1 Aug 09 12:13:52.119308 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO dbcounter [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Registered counter for database nova_cell1 Aug 09 12:13:52.126397 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:13:52.128147 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:13:52.130372 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_db.sqlalchemy.engines [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:13:52.132631 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writer thread running {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:13:52.133992 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_db.sqlalchemy.engines [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:13:52.136092 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writer thread running {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:13:52.267928 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writer thread running {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:13:52.273573 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writer thread running {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:13:52.277917 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO dbcounter [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Registered counter for database nova_cell0 Aug 09 12:13:52.283297 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO dbcounter [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Registered counter for database nova_cell0 Aug 09 12:13:52.285307 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:13:52.290438 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writer thread running {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:13:52.292710 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG oslo_db.sqlalchemy.engines [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:13:52.297374 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writer thread running {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:13:52.627039 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: WARNING keystonemiddleware.auth_token [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 12:13:52.628991 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: WARNING keystonemiddleware.auth_token [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 12:13:52.634396 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: WARNING keystonemiddleware.auth_token [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 12:13:52.636296 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: WARNING keystonemiddleware.auth_token [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 12:13:52.980698 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: WARNING keystonemiddleware.auth_token [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 12:13:52.984001 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: WARNING keystonemiddleware.auth_token [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 12:13:52.986993 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: WARNING keystonemiddleware.auth_token [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 12:13:52.990095 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: WARNING keystonemiddleware.auth_token [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 12:13:52.992251 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563814cf09c0 pid: 103156 (default app) Aug 09 12:13:52.994353 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:13:52.995365 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563814cf09c0 pid: 103157 (default app) Aug 09 12:13:52.995527 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-d0de5b32-595b-4ac1-9603-74e3d9064966 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Aug 09 12:13:52.995910 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Tue Aug 9 12:13:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:09.276060 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:09.277941 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002629 Aug 09 12:15:09.278347 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:09.290212 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writing DB stats nova_api:SELECT=3 {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:09.291362 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writing DB stats nova_cell0:SELECT=3 {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:09.292709 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writing DB stats nova_cell1:SELECT=3 {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:09.293450 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:10.133721 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-a470f82f-3788-48ec-b62b-5ad8f433dd5c admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:10.167090 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-a470f82f-3788-48ec-b62b-5ad8f433dd5c admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.882018 Aug 09 12:15:10.168430 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 2/3] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Aug 9 12:15:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:15:12.397945 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:12.399236 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1bc61569-f9f6-46e9-8008-9079216b2822 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Aug 09 12:15:12.399623 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 2/4] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:12.851918 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-3de26fc4-4993-4ced-90cc-e1f4236853b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "ram": 256, "name": "cirros256", "disk": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:12.871991 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:15:12.871991 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: warnings.warn(msg) Aug 09 12:15:12.906669 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-3de26fc4-4993-4ced-90cc-e1f4236853b0 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.500606 Aug 09 12:15:12.907199 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 3/5] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 12:15:12.920638 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_api:SELECT=3 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:12.921970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_cell0:SELECT=3 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:12.922920 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_cell1:SELECT=3 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:12.923647 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:13.127100 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-09695878-1e39-4977-8b9f-c2bce5b29ebf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:13.131479 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:15:13.131479 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: warnings.warn(msg) Aug 09 12:15:13.196957 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-09695878-1e39-4977-8b9f-c2bce5b29ebf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281347 Aug 09 12:15:13.197758 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 3/6] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Aug 9 12:15:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:15:15.414982 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-3de26fc4-4993-4ced-90cc-e1f4236853b0 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:15.416825 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-3de26fc4-4993-4ced-90cc-e1f4236853b0 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002261 Aug 09 12:15:15.417477 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 4/7] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:16.095251 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-01d8716c-3704-4a81-9f84-a1eed774a265 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:16.115720 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:15:16.115720 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: warnings.warn(msg) Aug 09 12:15:16.137953 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-01d8716c-3704-4a81-9f84-a1eed774a265 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.714090 Aug 09 12:15:16.138949 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 4/8] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:15:16.151403 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-e3c53120-9a2a-45dc-93a8-7a340128ab56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:16.154745 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:15:16.154745 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: warnings.warn(msg) Aug 09 12:15:16.192118 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-e3c53120-9a2a-45dc-93a8-7a340128ab56 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043819 Aug 09 12:15:16.193557 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 5/9] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Aug 9 12:15:16 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:15:18.475199 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-01d8716c-3704-4a81-9f84-a1eed774a265 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:18.476315 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-01d8716c-3704-4a81-9f84-a1eed774a265 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 09 12:15:18.476820 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:18.889095 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-f707384a-1720-47cc-9cd7-16c301d4aca2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G"}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:18.909194 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-f707384a-1720-47cc-9cd7-16c301d4aca2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426097 Aug 09 12:15:18.909662 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 6/11] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:15:18.921915 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1b813609-0125-4de0-9887-f6e98911b57a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:18.947034 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1b813609-0125-4de0-9887-f6e98911b57a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028971 Aug 09 12:15:18.947607 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 6/12] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Aug 9 12:15:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:15:21.129237 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-f707384a-1720-47cc-9cd7-16c301d4aca2 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:21.130398 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-f707384a-1720-47cc-9cd7-16c301d4aca2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001870 Aug 09 12:15:21.131114 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 7/13] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:21.586917 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-61b40d9f-82fd-4518-b625-7a27980536d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:21.615788 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-61b40d9f-82fd-4518-b625-7a27980536d7 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.478164 Aug 09 12:15:21.617140 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 7/14] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 12:15:21.632523 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-bc7c5818-6485-48a4-a4a7-1e439b65b399 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:21.671808 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-bc7c5818-6485-48a4-a4a7-1e439b65b399 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043464 Aug 09 12:15:21.673308 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 8/15] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Aug 9 12:15:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:15:23.870270 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-61b40d9f-82fd-4518-b625-7a27980536d7 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:23.871275 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-61b40d9f-82fd-4518-b625-7a27980536d7 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 09 12:15:23.871645 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 8/16] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:24.299500 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-adeef935-05b1-42ed-84b7-3cde986e3621 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:24.320828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-adeef935-05b1-42ed-84b7-3cde986e3621 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443007 Aug 09 12:15:24.321660 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 9/17] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 12:15:24.333691 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-193db808-715f-4f6c-9f9b-38737f1905b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:24.361422 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-193db808-715f-4f6c-9f9b-38737f1905b1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031322 Aug 09 12:15:24.362342 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 9/18] 10.222.0.60 () {64 vars in 1336 bytes} [Tue Aug 9 12:15:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:15:26.575917 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-adeef935-05b1-42ed-84b7-3cde986e3621 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:26.577477 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-adeef935-05b1-42ed-84b7-3cde986e3621 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Aug 09 12:15:26.578205 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 10/19] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:27.009756 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-64ac50da-95dd-40c5-a777-14c4a1d9b440 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:27.041458 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-64ac50da-95dd-40c5-a777-14c4a1d9b440 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456594 Aug 09 12:15:27.042165 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 10/20] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Aug 9 12:15:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:15:29.441436 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-adeef935-05b1-42ed-84b7-3cde986e3621 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:29.442681 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-adeef935-05b1-42ed-84b7-3cde986e3621 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Aug 09 12:15:29.443192 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 11/21] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:29.911992 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-d5bb1cde-8628-413f-9500-3d6b1cb2ab26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:29.931280 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-d5bb1cde-8628-413f-9500-3d6b1cb2ab26 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.480955 Aug 09 12:15:29.931876 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 11/22] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:15:29.944140 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-83ea431f-3cc9-44dc-a26a-2910eccc367c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:29.970087 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-83ea431f-3cc9-44dc-a26a-2910eccc367c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029713 Aug 09 12:15:29.970714 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 12/23] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Aug 9 12:15:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:15:32.149762 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-d5bb1cde-8628-413f-9500-3d6b1cb2ab26 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:32.150683 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-d5bb1cde-8628-413f-9500-3d6b1cb2ab26 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 09 12:15:32.151082 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 12/24] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:32.548358 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-079b7766-344c-414a-964b-e543e9a1baa3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 2048, "disk": 20, "name": "m1.small"}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:32.569480 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-079b7766-344c-414a-964b-e543e9a1baa3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411603 Aug 09 12:15:32.570099 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 13/25] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:15:32.582889 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-bb2e464f-a813-478a-b44d-0211062c5881 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:32.608401 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-bb2e464f-a813-478a-b44d-0211062c5881 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029089 Aug 09 12:15:32.609011 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 13/26] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Aug 9 12:15:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:15:34.804698 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-079b7766-344c-414a-964b-e543e9a1baa3 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:34.805742 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-079b7766-344c-414a-964b-e543e9a1baa3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 09 12:15:34.806142 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 14/27] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:35.241973 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-3e747210-1c8d-41dc-9ae2-1c91ee0d3139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:35.264416 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-3e747210-1c8d-41dc-9ae2-1c91ee0d3139 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.451357 Aug 09 12:15:35.265241 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 14/28] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:15:35.278578 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-690d9e05-ff95-45f2-85dd-32ab99e0d6b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:35.314065 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-690d9e05-ff95-45f2-85dd-32ab99e0d6b2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039511 Aug 09 12:15:35.314986 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 15/29] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Aug 9 12:15:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:15:37.541758 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-3e747210-1c8d-41dc-9ae2-1c91ee0d3139 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:37.542783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-3e747210-1c8d-41dc-9ae2-1c91ee0d3139 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 09 12:15:37.543197 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 15/30] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:38.001967 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-064304ac-309c-404e-877d-5fb14079e49f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "rxtx_factor": 1.0}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:38.022922 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-064304ac-309c-404e-877d-5fb14079e49f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472245 Aug 09 12:15:38.023493 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 16/31] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:15:38.037917 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-2cb3b80a-9ba4-4ef2-a2a9-e13412f0df8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:38.063091 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-2cb3b80a-9ba4-4ef2-a2a9-e13412f0df8b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028872 Aug 09 12:15:38.063756 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 16/32] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Aug 9 12:15:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:15:40.276202 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-064304ac-309c-404e-877d-5fb14079e49f admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:15:40.277905 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-064304ac-309c-404e-877d-5fb14079e49f admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Aug 09 12:15:40.278370 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 17/33] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:15:40.713092 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-457af5c8-2b45-4bb3-9576-c82df414336c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:40.738267 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-457af5c8-2b45-4bb3-9576-c82df414336c admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453897 Aug 09 12:15:40.738990 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 17/34] 10.222.0.60 () {64 vars in 1283 bytes} [Tue Aug 9 12:15:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:15:40.751137 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-85924995-81ca-4ac3-8cbd-97633d462ba3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:15:40.756127 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:40.787490 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-85924995-81ca-4ac3-8cbd-97633d462ba3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039542 Aug 09 12:15:40.796855 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 18/35] 10.222.0.60 () {64 vars in 1333 bytes} [Tue Aug 9 12:15:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:16:01.261499 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-457af5c8-2b45-4bb3-9576-c82df414336c admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:01.262490 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-457af5c8-2b45-4bb3-9576-c82df414336c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001824 Aug 09 12:16:01.263025 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 18/36] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:16:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:01.277079 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:01.699069 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-f828f63b-0ac0-4b8b-9f4d-3078fe3d3582 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:01.717144 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-f828f63b-0ac0-4b8b-9f4d-3078fe3d3582 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.447575 Aug 09 12:16:01.717673 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 19/37] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Aug 9 12:16:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:16:02.797692 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-457af5c8-2b45-4bb3-9576-c82df414336c admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:02.798943 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-457af5c8-2b45-4bb3-9576-c82df414336c admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001913 Aug 09 12:16:02.799399 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 19/38] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:16:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:03.357753 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-ffa9ab87-2d44-46dc-b41a-5563088e25e3 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:03.363485 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.wsgi [None req-ffa9ab87-2d44-46dc-b41a-5563088e25e3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-ffa9ab87-2d44-46dc-b41a-5563088e25e3 admin admin] Request method failure captured: Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Accept: application/json Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Accept-Encoding: gzip, deflate Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Connection: keep-alive Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Content-Length: 0 Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Host: 10.222.0.60 Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Openstack-Api-Version: compute 2.90 Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Openstack-System-Scope: None Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: User-Agent: python-novaclient Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Auth-Token: gAAAAABi8lACD4_59-tyLd3UtAJt1_aH2dxbsNbJ1H-MRyj9n3ZAOXA8fXoNPKUbUvKLl0l7zrUrtJi1rsxqB3TEJydgVjFJZUUJA-5qgSPT9II448C7f-uPbmbFUv2CVWZ0NchWbd8eHUtqF0omScMchdr7dIKlhzNGcF7es2IPPbG9KXLbwy8 Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Domain-Id: None Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Domain-Name: None Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Identity-Status: Confirmed Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Is-Admin-Project: True Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Domain-Id: default Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Domain-Name: Default Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Name: admin Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Role: admin,member,reader Aug 09 12:16:03.366777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Roles: admin,member,reader Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant: admin Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant-Name: admin Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User: admin Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Domain-Id: default Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Domain-Name: Default Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Id: 881d465484874e7283e8dee880624ffb Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Name: admin Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: method: > Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: exception: Flavor 42 could not be found. Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: action_args: {'id': '42'} Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:16:03.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:03.369341 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.370580 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-ffa9ab87-2d44-46dc-b41a-5563088e25e3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:16:03.371632 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-ffa9ab87-2d44-46dc-b41a-5563088e25e3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.427722 Aug 09 12:16:03.371632 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 20/39] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Aug 9 12:16:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:03.378445 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-944b5528-24bc-447b-aad2-d5c15c8f7350 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:03.382687 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:03.402215 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-944b5528-24bc-447b-aad2-d5c15c8f7350 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027486 Aug 09 12:16:03.402801 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 20/40] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Aug 9 12:16:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:16:03.414519 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-5ed456da-64c4-4c2f-9829-02bb5edccdf3 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:03.445555 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-5ed456da-64c4-4c2f-9829-02bb5edccdf3 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.036214 Aug 09 12:16:03.446057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 21/41] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Aug 9 12:16:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:16:03.456181 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-66bf1bc0-5dcb-4b4c-844a-4e22790246f6 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:03.462341 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.wsgi [None req-66bf1bc0-5dcb-4b4c-844a-4e22790246f6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-66bf1bc0-5dcb-4b4c-844a-4e22790246f6 admin admin] Request method failure captured: Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Accept: application/json Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Accept-Encoding: gzip, deflate Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Connection: keep-alive Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Content-Length: 0 Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Host: 10.222.0.60 Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Openstack-Api-Version: compute 2.90 Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Openstack-System-Scope: None Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: User-Agent: python-novaclient Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Auth-Token: gAAAAABi8lACD4_59-tyLd3UtAJt1_aH2dxbsNbJ1H-MRyj9n3ZAOXA8fXoNPKUbUvKLl0l7zrUrtJi1rsxqB3TEJydgVjFJZUUJA-5qgSPT9II448C7f-uPbmbFUv2CVWZ0NchWbd8eHUtqF0omScMchdr7dIKlhzNGcF7es2IPPbG9KXLbwy8 Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Domain-Id: None Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Domain-Name: None Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Identity-Status: Confirmed Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Is-Admin-Project: True Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Id: default Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Name: Default Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Name: admin Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Role: admin,member,reader Aug 09 12:16:03.465587 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Roles: admin,member,reader Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant: admin Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant-Name: admin Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User: admin Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Id: default Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Name: Default Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Id: 881d465484874e7283e8dee880624ffb Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Name: admin Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: method: > Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: exception: Flavor 42 could not be found. Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: action_args: {'id': '42'} Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:16:03.466970 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:03.467783 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:03.469380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-66bf1bc0-5dcb-4b4c-844a-4e22790246f6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:16:03.470614 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-66bf1bc0-5dcb-4b4c-844a-4e22790246f6 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014783 Aug 09 12:16:03.470614 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 21/42] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Aug 9 12:16:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 09 12:16:04.473707 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-5ed456da-64c4-4c2f-9829-02bb5edccdf3 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:04.474720 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-5ed456da-64c4-4c2f-9829-02bb5edccdf3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 09 12:16:04.475123 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 22/43] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:16:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:05.048597 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-c4c15a73-2db5-43d2-946e-749053dc0ebf admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:05.054118 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.wsgi [None req-c4c15a73-2db5-43d2-946e-749053dc0ebf admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-c4c15a73-2db5-43d2-946e-749053dc0ebf admin admin] Request method failure captured: Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Accept: application/json Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Accept-Encoding: gzip, deflate Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Connection: keep-alive Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Content-Length: 0 Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Host: 10.222.0.60 Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Openstack-Api-Version: compute 2.90 Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Openstack-System-Scope: None Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: User-Agent: python-novaclient Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Auth-Token: gAAAAABi8lAEqirnuQlL8-sW1isC_cvdf65VquoOCUqYbp8AFnrduq8UJ9TjgESM31DdTsG-nv4RXffDe318l8Ov79fKnQ5MtGy_GlnvZhzFd6C0EW6Js3X7N105SPf48IcS4_3F8W3391ulZJ0lT5u9cVhoow_gbEhDpc4nP33ZA8cjI1CM0Gw Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Domain-Id: None Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Domain-Name: None Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Identity-Status: Confirmed Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Is-Admin-Project: True Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Id: default Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Name: Default Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Name: admin Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Role: admin,member,reader Aug 09 12:16:05.055627 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Roles: admin,member,reader Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant: admin Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant-Name: admin Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User: admin Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Id: default Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Name: Default Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Id: 881d465484874e7283e8dee880624ffb Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Name: admin Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: method: > Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: exception: Flavor 84 could not be found. Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: action_args: {'id': '84'} Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:16:05.057028 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:05.057833 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.059144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-c4c15a73-2db5-43d2-946e-749053dc0ebf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:16:05.060409 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-c4c15a73-2db5-43d2-946e-749053dc0ebf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.444020 Aug 09 12:16:05.060409 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 22/44] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Aug 9 12:16:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:05.067399 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-8d632089-2b97-4536-ba86-7e98c2268d72 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:05.086533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-8d632089-2b97-4536-ba86-7e98c2268d72 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022450 Aug 09 12:16:05.087410 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Aug 9 12:16:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:16:05.097591 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-bda0052d-783b-416d-9c0d-061026b99e93 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:05.113380 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-bda0052d-783b-416d-9c0d-061026b99e93 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019882 Aug 09 12:16:05.113903 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Aug 9 12:16:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:16:05.123398 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-77b6d886-aad2-4495-80b1-acbc951b4b49 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:05.129040 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.wsgi [None req-77b6d886-aad2-4495-80b1-acbc951b4b49 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-77b6d886-aad2-4495-80b1-acbc951b4b49 admin admin] Request method failure captured: Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Accept: application/json Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Accept-Encoding: gzip, deflate Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Connection: keep-alive Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Content-Length: 0 Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Host: 10.222.0.60 Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Openstack-Api-Version: compute 2.90 Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Openstack-System-Scope: None Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: User-Agent: python-novaclient Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Auth-Token: gAAAAABi8lAEqirnuQlL8-sW1isC_cvdf65VquoOCUqYbp8AFnrduq8UJ9TjgESM31DdTsG-nv4RXffDe318l8Ov79fKnQ5MtGy_GlnvZhzFd6C0EW6Js3X7N105SPf48IcS4_3F8W3391ulZJ0lT5u9cVhoow_gbEhDpc4nP33ZA8cjI1CM0Gw Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Domain-Id: None Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Domain-Name: None Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Identity-Status: Confirmed Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Is-Admin-Project: True Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Domain-Id: default Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Domain-Name: Default Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Name: admin Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Role: admin,member,reader Aug 09 12:16:05.130533 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Roles: admin,member,reader Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant: admin Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant-Name: admin Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User: admin Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Domain-Id: default Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Domain-Name: Default Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Id: 881d465484874e7283e8dee880624ffb Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Name: admin Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: method: > Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: exception: Flavor 84 could not be found. Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: action_args: {'id': '84'} Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:16:05.131970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:05.132828 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:05.134057 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-77b6d886-aad2-4495-80b1-acbc951b4b49 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:16:05.135045 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-77b6d886-aad2-4495-80b1-acbc951b4b49 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012163 Aug 09 12:16:05.135045 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 24/47] 10.222.0.60 () {60 vars in 1190 bytes} [Tue Aug 9 12:16:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:06.111229 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-bda0052d-783b-416d-9c0d-061026b99e93 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:06.112231 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-bda0052d-783b-416d-9c0d-061026b99e93 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 09 12:16:06.112656 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 24/48] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:06.689358 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-88612749-5290-4358-9ad5-455773e82566 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:06.695239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.wsgi [None req-88612749-5290-4358-9ad5-455773e82566 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-88612749-5290-4358-9ad5-455773e82566 admin admin] Request method failure captured: Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Accept: application/json Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Accept-Encoding: gzip, deflate Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Connection: keep-alive Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Content-Length: 0 Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Host: 10.222.0.60 Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Openstack-Api-Version: compute 2.90 Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Openstack-System-Scope: None Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: User-Agent: python-novaclient Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Auth-Token: gAAAAABi8lAFVefTWoMICyKpM7kHHW76TKb-il39Co0z8atDLRLxUCaI497wmE9tHuh_H7-lxeGbxkUcbNPZU7PVI2iIdGdfsrDnjiGNkqfSy8Lf7mIRk-Eu9WQyIpTR2Z3Tgnlup0e2Yg6CoJLp_li01sr5WQ0j8kMPHHOIBHpMpP3qB4vvGNk Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Domain-Id: None Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Domain-Name: None Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Identity-Status: Confirmed Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Is-Admin-Project: True Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Domain-Id: default Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Domain-Name: Default Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Project-Name: admin Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Role: admin,member,reader Aug 09 12:16:06.696777 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Roles: admin,member,reader Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant: admin Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-Tenant-Name: admin Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User: admin Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Domain-Id: default Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Domain-Name: Default Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Id: 881d465484874e7283e8dee880624ffb Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: X-User-Name: admin Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: method: > Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: exception: Flavor 451 could not be found. Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: action_args: {'id': '451'} Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:16:06.698239 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:06.699211 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.700713 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-88612749-5290-4358-9ad5-455773e82566 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:16:06.702003 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-88612749-5290-4358-9ad5-455773e82566 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.451231 Aug 09 12:16:06.702003 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 25/49] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Aug 9 12:16:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:06.708854 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-41885f39-1818-42e3-94dc-e13a486f65b9 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:06.725484 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-41885f39-1818-42e3-94dc-e13a486f65b9 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020230 Aug 09 12:16:06.726002 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 25/50] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Aug 9 12:16:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:16:06.735660 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:06.751118 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019158 Aug 09 12:16:06.751645 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 26/51] 10.222.0.60 () {60 vars in 1210 bytes} [Tue Aug 9 12:16:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:16:06.761454 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-53f35aa0-f104-4317-b4ae-3f9ef7d0c057 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:06.767581 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.wsgi [None req-53f35aa0-f104-4317-b4ae-3f9ef7d0c057 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-53f35aa0-f104-4317-b4ae-3f9ef7d0c057 admin admin] Request method failure captured: Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Accept: application/json Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Accept-Encoding: gzip, deflate Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Connection: keep-alive Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Content-Length: 0 Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Host: 10.222.0.60 Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Openstack-Api-Version: compute 2.90 Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Openstack-System-Scope: None Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: User-Agent: python-novaclient Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Auth-Token: gAAAAABi8lAFVefTWoMICyKpM7kHHW76TKb-il39Co0z8atDLRLxUCaI497wmE9tHuh_H7-lxeGbxkUcbNPZU7PVI2iIdGdfsrDnjiGNkqfSy8Lf7mIRk-Eu9WQyIpTR2Z3Tgnlup0e2Yg6CoJLp_li01sr5WQ0j8kMPHHOIBHpMpP3qB4vvGNk Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Domain-Id: None Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Domain-Name: None Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Identity-Status: Confirmed Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Is-Admin-Project: True Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Id: default Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Name: Default Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Project-Name: admin Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Role: admin,member,reader Aug 09 12:16:06.769396 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Roles: admin,member,reader Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/865c26d1046a4242bbaffa7d1b6dfc7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant: admin Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant-Id: 865c26d1046a4242bbaffa7d1b6dfc7e Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-Tenant-Name: admin Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User: admin Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Id: default Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Name: Default Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Id: 881d465484874e7283e8dee880624ffb Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: X-User-Name: admin Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: method: > Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: exception: Flavor 451 could not be found. Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: action_args: {'id': '451'} Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:16:06.771096 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:06.772427 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Aug 09 12:16:06.774139 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-53f35aa0-f104-4317-b4ae-3f9ef7d0c057 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:16:06.775572 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-53f35aa0-f104-4317-b4ae-3f9ef7d0c057 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013247 Aug 09 12:16:06.775572 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 26/52] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Aug 9 12:16:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:07.770468 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:07.771970 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Aug 09 12:16:07.772453 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 27/53] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:08.350037 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-53952697-b4ea-4eae-8a2d-3805a8c6ea28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:16:08.375034 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-53952697-b4ea-4eae-8a2d-3805a8c6ea28 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.457072 Aug 09 12:16:08.375662 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 27/54] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Aug 9 12:16:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:16:09.365283 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:09.366288 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 09 12:16:09.366689 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 28/55] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:16:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:09.939814 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-36a7e6dd-3177-4f42-8713-37d361fa6668 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:16:09.963534 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-36a7e6dd-3177-4f42-8713-37d361fa6668 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.460971 Aug 09 12:16:09.964072 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 28/56] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Aug 9 12:16:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:16:10.942980 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:10.944023 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 09 12:16:10.944402 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 29/57] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:16:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:11.507921 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-451b82c5-a717-416c-91da-95ce79b1d93a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:16:11.533391 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-451b82c5-a717-416c-91da-95ce79b1d93a admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.451598 Aug 09 12:16:11.534199 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 29/58] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Aug 9 12:16:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:16:12.520238 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:12.521288 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 09 12:16:12.521683 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 30/59] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:13.095802 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-799b86cc-3760-48fa-a0cf-f35b8f6f566f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:16:13.117175 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-799b86cc-3760-48fa-a0cf-f35b8f6f566f admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458732 Aug 09 12:16:13.117721 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 30/60] 10.222.0.60 () {64 vars in 1235 bytes} [Tue Aug 9 12:16:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:16:14.256177 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:14.257227 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 09 12:16:14.257618 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 31/61] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:16:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:16:14.825477 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-300b16e0-c2e2-4880-8aaa-5d85d6087832 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:16:14.846663 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-300b16e0-c2e2-4880-8aaa-5d85d6087832 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.450079 Aug 09 12:16:14.847201 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 31/62] 10.222.0.60 () {60 vars in 1202 bytes} [Tue Aug 9 12:16:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:17:06.845212 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:17:06.846255 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-04799d95-b34e-4ffa-9505-b633a538c648 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 09 12:17:06.846645 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 32/63] 10.222.0.60 () {54 vars in 931 bytes} [Tue Aug 9 12:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:17:06.857348 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:07.260045 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-5163b6d5-11ed-47bc-a91b-9639d1a11999 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:17:07.281144 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-5163b6d5-11ed-47bc-a91b-9639d1a11999 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428305 Aug 09 12:17:07.281599 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 32/64] 10.222.0.60 () {60 vars in 1292 bytes} [Tue Aug 9 12:17:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:17:07.313738 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG dbcounter [-] [103156] Writing DB stats nova_api:SELECT=14 {{(pid=103156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:07.317671 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-fe5f4c89-2bdd-4737-b27a-121b072f154f admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:17:07.325588 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-fe5f4c89-2bdd-4737-b27a-121b072f154f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013311 Aug 09 12:17:07.326096 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 33/65] 10.222.0.60 () {60 vars in 1283 bytes} [Tue Aug 9 12:17:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:17:07.337732 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-35e6b0a1-34b7-43fe-a289-6a0f4c0c9f3d admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:17:07.345593 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-35e6b0a1-34b7-43fe-a289-6a0f4c0c9f3d admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011434 Aug 09 12:17:07.346377 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 33/66] 10.222.0.60 () {60 vars in 1286 bytes} [Tue Aug 9 12:17:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:17:07.364276 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:17:07.375176 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016589 Aug 09 12:17:07.375700 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 34/67] 10.222.0.60 () {60 vars in 1286 bytes} [Tue Aug 9 12:17:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:17:07.387329 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-e2cab493-91d8-4564-b82c-16d3d2cd563b admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:17:07.395785 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-e2cab493-91d8-4564-b82c-16d3d2cd563b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012344 Aug 09 12:17:07.396287 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 34/68] 10.222.0.60 () {60 vars in 1283 bytes} [Tue Aug 9 12:17:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:19:59.473273 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:19:59.474294 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 09 12:19:59.474722 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 35/69] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:19:59.616458 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_api:SELECT=6 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:19:59.793861 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-f12a382e-4b3f-4e6d-b5fc-9c9b40a8bafa admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:19:59.796206 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:19:59.796206 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: warnings.warn(msg) Aug 09 12:19:59.797345 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-f12a382e-4b3f-4e6d-b5fc-9c9b40a8bafa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:19:59.797842 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-f12a382e-4b3f-4e6d-b5fc-9c9b40a8bafa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:19:59.798493 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-f12a382e-4b3f-4e6d-b5fc-9c9b40a8bafa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:19:59.798991 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-f12a382e-4b3f-4e6d-b5fc-9c9b40a8bafa admin admin] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:19:59.799429 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-f12a382e-4b3f-4e6d-b5fc-9c9b40a8bafa admin admin] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:19:59.799847 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-f12a382e-4b3f-4e6d-b5fc-9c9b40a8bafa admin admin] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:19:59.833709 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-f12a382e-4b3f-4e6d-b5fc-9c9b40a8bafa admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.219812 Aug 09 12:19:59.834264 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 35/70] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Aug 9 12:19:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:20:00.667680 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:20:00.669022 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Aug 09 12:20:00.669544 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 36/71] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:20:00.871932 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-abe5140b-d0c8-44e4-86a9-6c0eceba7bfb admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:20:00.874348 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:20:00.874348 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: warnings.warn(msg) Aug 09 12:20:00.875449 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-abe5140b-d0c8-44e4-86a9-6c0eceba7bfb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:20:00.876231 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-abe5140b-d0c8-44e4-86a9-6c0eceba7bfb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:20:00.877068 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-abe5140b-d0c8-44e4-86a9-6c0eceba7bfb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:20:00.877786 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-abe5140b-d0c8-44e4-86a9-6c0eceba7bfb admin admin] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:20:00.878233 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-abe5140b-d0c8-44e4-86a9-6c0eceba7bfb admin admin] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:20:00.878656 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-abe5140b-d0c8-44e4-86a9-6c0eceba7bfb admin admin] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:20:00.899360 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-abe5140b-d0c8-44e4-86a9-6c0eceba7bfb admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.093352 Aug 09 12:20:00.899929 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 36/72] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Aug 9 12:20:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:20:12.139919 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:20:12.141200 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Aug 09 12:20:12.141664 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:20:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:20:12.289995 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_cell0:SELECT=4 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:20:12.291041 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_cell1:SELECT=4 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:20:12.292007 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_api:SELECT=8 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:20:12.347299 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-aefe1eba-2740-43b3-8839-3371d7964f35 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:20:12.350007 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:20:12.350007 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: warnings.warn(msg) Aug 09 12:20:12.351114 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-aefe1eba-2740-43b3-8839-3371d7964f35 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:20:12.351601 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-aefe1eba-2740-43b3-8839-3371d7964f35 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:20:12.352041 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-aefe1eba-2740-43b3-8839-3371d7964f35 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:20:12.352777 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-aefe1eba-2740-43b3-8839-3371d7964f35 admin admin] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:20:12.353221 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-aefe1eba-2740-43b3-8839-3371d7964f35 admin admin] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:20:12.353629 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-aefe1eba-2740-43b3-8839-3371d7964f35 admin admin] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:20:12.378968 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-aefe1eba-2740-43b3-8839-3371d7964f35 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.097385 Aug 09 12:20:12.379510 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 37/74] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Aug 9 12:20:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:20:13.202967 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: DEBUG nova.api.openstack.wsgi [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] Calling method '>' {{(pid=103156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:20:13.204279 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: INFO nova.api.openstack.requestlog [None req-3cc0e4db-3ce5-415b-8be5-5df454c7a580 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Aug 09 12:20:13.205205 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: [pid: 103156|app: 0|req: 38/75] 10.222.0.60 () {56 vars in 1074 bytes} [Tue Aug 9 12:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:20:13.415173 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-8558c893-9ceb-44f4-a8c0-460cad5908cf admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:20:13.417594 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:20:13.417594 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: warnings.warn(msg) Aug 09 12:20:13.418657 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-8558c893-9ceb-44f4-a8c0-460cad5908cf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:20:13.419128 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-8558c893-9ceb-44f4-a8c0-460cad5908cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:20:13.419552 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-8558c893-9ceb-44f4-a8c0-460cad5908cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:20:13.420258 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-8558c893-9ceb-44f4-a8c0-460cad5908cf admin admin] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:20:13.420730 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-8558c893-9ceb-44f4-a8c0-460cad5908cf admin admin] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:20:13.421148 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-8558c893-9ceb-44f4-a8c0-460cad5908cf admin admin] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:20:13.444808 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-8558c893-9ceb-44f4-a8c0-460cad5908cf admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095052 Aug 09 12:20:13.445374 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 38/76] 10.222.0.60 () {60 vars in 1193 bytes} [Tue Aug 9 12:20:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:21:10.952075 dv-cinder-852369-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 12:21:10.956493 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: Tue Aug 9 12:21:10 2022 - graceful shutdown triggered... Aug 09 12:21:10.956949 dv-cinder-852369-1-iscsi devstack@n-api.service[103156]: Gracefully killing worker 1 (pid: 103156)... Aug 09 12:21:10.957325 dv-cinder-852369-1-iscsi devstack@n-api.service[103157]: Gracefully killing worker 2 (pid: 103157)... Aug 09 12:21:11.953457 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: worker 1 buried after 1 seconds Aug 09 12:21:11.953457 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: worker 2 buried after 1 seconds Aug 09 12:21:11.953457 dv-cinder-852369-1-iscsi devstack@n-api.service[103155]: goodbye to uWSGI. Aug 09 12:21:11.956029 dv-cinder-852369-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 12:21:11.956967 dv-cinder-852369-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 12:21:11.961684 dv-cinder-852369-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 12:21:11.974126 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 12:21:11 2022] *** Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: nodename: dv-cinder-852369-1-iscsi Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: machine: x86_64 Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: clock source: unix Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: pcre jit disabled Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: detected number of CPU cores: 4 Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: current working directory: / Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: detected binary path: /usr/bin/uwsgi-core Aug 09 12:21:11.976129 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: your processes number limit is 47680 Aug 09 12:21:11.976875 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: your memory page size is 4096 bytes Aug 09 12:21:11.976875 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: detected max file descriptor number: 2048 Aug 09 12:21:11.976875 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: lock engine: pthread robust mutexes Aug 09 12:21:11.976875 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: thunder lock: enabled Aug 09 12:21:11.976875 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 12:21:11.976875 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 12:21:12.016883 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: Python main interpreter initialized at 0x563ad8b999c0 Aug 09 12:21:12.016883 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: python threads support enabled Aug 09 12:21:12.016883 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: your server socket listen backlog is limited to 100 connections Aug 09 12:21:12.016883 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: your mercy for graceful operations on workers is 90 seconds Aug 09 12:21:12.017369 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 12:21:12.017369 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: *** Operational MODE: preforking *** Aug 09 12:21:12.017595 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: *** uWSGI is running in multiple interpreter mode *** Aug 09 12:21:12.017595 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: spawned uWSGI master process (pid: 117648) Aug 09 12:21:12.017842 dv-cinder-852369-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 12:21:12.019145 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: spawned uWSGI worker 1 (pid: 117660, cores: 1) Aug 09 12:21:12.019145 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: spawned uWSGI worker 2 (pid: 117661, cores: 1) Aug 09 12:21:12.019145 dv-cinder-852369-1-iscsi devstack@n-api.service[117648]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 12:21:12.673014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 12:21:12.674829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 12:21:13.825479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:21:13.825479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: from cryptography.utils import int_from_bytes Aug 09 12:21:13.826165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:21:13.826165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: from cryptography.utils import int_from_bytes Aug 09 12:21:13.829064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:21:13.829064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: from cryptography.utils import int_from_bytes Aug 09 12:21:13.829550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:21:13.829550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: from cryptography.utils import int_from_bytes Aug 09 12:21:16.143924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 12:21:16.144618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 12:21:16.144618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 12:21:16.145000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 12:21:16.145251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 12:21:16.145634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.145957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.146271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.146584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.147005 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.147349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.147567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.147945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.148356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.148658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.148986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.149390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852369-1-iscsi {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.149671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.149981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.150308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.150625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.150923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.151237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.151553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.152035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.153616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.154671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.154671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.154671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.154938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.155140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.155459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.155981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.156411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.156884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.157311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852369-1-iscsi {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.157751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.158078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.158382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.158801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.159114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.159423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.159742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.160060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.160363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.160709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.161026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.161341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.161657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.161957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.162262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.162568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.162891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.163187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.163490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.163738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.164043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.164361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.164700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.165016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.165267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.165515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.165949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.166278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.166587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.166893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.167201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.167506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.167809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.168114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.168435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.168741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.169055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.169367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.169681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.169986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.170301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.170691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.170938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.171241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.171576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.171887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.172372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.172866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.173225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.173533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.173836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.174159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.174456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.174787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.175089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.175336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.175633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.175938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.176251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.176577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.176879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.177185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.177481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.177781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.178083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.178470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.178801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.179155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.179466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.179823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.180183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.180599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.180832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.181152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.181457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.181760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.182062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.182365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.182731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.182981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.183283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.183597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.183900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.184200 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.184533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.184841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.185142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.185509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.185815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.186178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.186641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.186991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.187288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.187599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.187987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.188422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.188758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.189062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.189367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.189664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.189978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.190297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.190662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.191035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.191343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.191597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 12:21:16.192031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.192134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 12:21:16.192229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.192501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.192609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 12:21:16.192846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.192957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 12:21:16.193120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 12:21:16.193223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.193515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.193614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.193845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.193959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.194169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.194272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.194474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.194616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.194849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.194960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.195315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.195551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.195733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.195908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.196074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.196330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.196548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.196870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.197034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.197188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.197350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.197506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.197653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.197796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852369-1-iscsi {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.197950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.198102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.198265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.198418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.198658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.198808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.198995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.199170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.199323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.199475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.199621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.199765 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.199911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.200077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.200223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.200522 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.200769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.200939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.201125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.201286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.201432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.201583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.201738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.201882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.202038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.202182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.202329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.202511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.202671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.202823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.202981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.203145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.203296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.203500 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.203665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.203665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.203961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.204113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.204267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852369-1-iscsi {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.204442 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.204593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.204749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.204895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.205050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.205206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.205351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.205574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.205728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.205873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.206017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.206169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.206323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.206586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.206738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.207044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.207208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.207376 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.207535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.207694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.207847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.207847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.208146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.208299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.208484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.208667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.208823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.208979 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.209135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.209280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.209454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.209608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.209758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.209902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.210047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.210191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.210346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.210500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.210684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.210684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.210976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.211120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.211288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.211441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.211594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.211744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.211896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.211896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.212186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.212186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.212511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.212658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.212811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.212970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.213128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.213273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.213426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.213581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.213734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.213890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.214034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.214184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.214339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.214490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.214648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.214792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.214935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.215130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.215292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.215445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.215603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.215755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.215907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.216062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.216206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.216359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.216573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.216804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.216804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.216804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.217341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.217341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.217641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.217641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.217942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.218089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.218240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.218394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.218547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.218699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.218843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.219016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.219182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.219336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.219545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.219691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.219841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.219841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.220123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.220287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.220467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.220625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.220777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.220928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.221071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.221224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.221224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.221507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.221507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.221797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.221941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.222092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.222245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.222396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.222541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.222685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.222837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.223001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.223145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.223339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.223491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.223636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.223780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.223940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.224091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.224243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.224430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.224593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.224739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.224896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.225059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.225205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.225355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.225500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.225643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.225804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.225956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.226107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.226251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.226251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.226541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.226724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.226973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.227140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.227389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.227539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.227693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.227854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.228010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.228171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.228315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.228481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.228644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.228797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.228949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.228949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.229257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.229257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.229533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.229677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.229821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.229981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.230126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.230278 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.230429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.230581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.230733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.230888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.231044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.231205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.231350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.231609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.231766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.231991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.232147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.232301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.232487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.232726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.232894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.233040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.233185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.233329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.233501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.233647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.233807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.233952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.234104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.234250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.234402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.234547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.234815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.234975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.235120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.235265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.235422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.235575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.235729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.235881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.236037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.236037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.236037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.236498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.236645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.236792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.236962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.237192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.237341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.237509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.237755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.237912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.238068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.238213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:21:16.238358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.238515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.238667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.238827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.238988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.239132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.239319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.239477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.239642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.239642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.239923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.240076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.240232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.240429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.240591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.240746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.240890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.241035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.241194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.241340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.241496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.241648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.241801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.241954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.242111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.242256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.242398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.242552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.242696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.242848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.243006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.243151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.243295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.243450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.243595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.243748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.243906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.244052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.244195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.244348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.244526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.244683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.244834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.244986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.245138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.245290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.245451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.246208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.246360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.246506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.246650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.246796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.246941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.247099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.247339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.247490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.247642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.247806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.247806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.248207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.248207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.248588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.248743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.248890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.249043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.249199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.249352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.249497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.249648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.249801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.249956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.250111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.250277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.250466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.250613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.250759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.250998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.251147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.251306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.251451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.251611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.251771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.251923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.252069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.252224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.252369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.252557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.252714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.252714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.252998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.253149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.253300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.253452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.253604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.253748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.253892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.254042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.254196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.254349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.254539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.254687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.254830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.254981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.255126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.255279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.255812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.255812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.256099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.256245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.256415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.256596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.256744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.256896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.257040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.257185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.257347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.257588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.257746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.257898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.258064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.258300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.258450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.258615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.258760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.258912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.259076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.259220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.259367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.259511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.259655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.259798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.259956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.260100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.260253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.260417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.260579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.260725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.260966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.261113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.261259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.261413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.261559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.261717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.261863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.262014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.262160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.262303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.262455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.262626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.262781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.262933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.263086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.263230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.263375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.263527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.263681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.263681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.263963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.264107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.264251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.264454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.264608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.264760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.264904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.265055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.265207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.265358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.265512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.265664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.265816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.265995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.266154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.266299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.266461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.266606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.266758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.266903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.267057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.267210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.267354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.267507 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.267751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.267909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.268064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.268218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.268481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.268643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.268643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.268643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.269081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.269234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.269385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.269529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.269673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.269831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.269975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.270118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.270275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.270420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.270575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.270727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.270872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.271017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.271159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.271313 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.271512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.271671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.271817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.271970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.272129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.272288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.272483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.272631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.272790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.272943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.273093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.273253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.273423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.273581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.273733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.273883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.274043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.274202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.274367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.274536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.274695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.274854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.275014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.275174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.275348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.275509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.275669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.275827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.275978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.276143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.276369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.276606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.276769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.276931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.277084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.277245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.277396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.277554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.277554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.277947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.278105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.278267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.278666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.278860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.279027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.279203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.279357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.279517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.279678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.279838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.279990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.280141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.280302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.280489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.280645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.280796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.280947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.281104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.281276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.281435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.281711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.281871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.282023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.282173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.282338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.282499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.282659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.282811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.282962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.283113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.283272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.283443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.283596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.283746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.283905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.284075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.284227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.284440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.284600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.284762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.284914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.285081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.285232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.285232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.285232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.285686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.285844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.286053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.286207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.286357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.286522 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.286682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.286841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.287006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.287157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.287307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.287473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.287664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.287835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.288088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.288247 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.288425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.288595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.288885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.289060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.289212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.289372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.289537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.289690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.289852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.290013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.290172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.290324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.290475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.290635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.290788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.290953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.291120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.291279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.291440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.291599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.291764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.291935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.292094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.292245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.292413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.292571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.292739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.292892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.293043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.293194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.293351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.293502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.293735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.293889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.294051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.294203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.294352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.294511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.294677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.294837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.294996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.295148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.295298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.295449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.295618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.295778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.295947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.296107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.296265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.296478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.296637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.296797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.296956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.297145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.297362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.297530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.297682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.297851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.298011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.298272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.298430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.298598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.298759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.298927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.299175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.299340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.299492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.299653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.299812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.299964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.300121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.300274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.300464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.300623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.300773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.300936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.301096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.301258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.301486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.301640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.301797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.301956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.302107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.302257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.302257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.302257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.302708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.302868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.303019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.303208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.303378 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.303531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.303689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.303841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.303990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.304155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.304155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.304501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.304656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.304816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.304967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.305127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.305286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.305286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.305583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.305733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.305883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.306049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.306200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.306351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.306526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.306526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.306813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.306972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.307124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.307287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.307450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.307611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.307775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.307947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.308098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.308267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.308539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.308698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.308850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.309008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.309186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.309433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.309600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.309760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.309920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.310073 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.310224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.310383 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.310535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.310709 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.310870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.311029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.311182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.311346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.311499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.311649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.311800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.311961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.312121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.312286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.312494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.312665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.312884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.313050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.313210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.313374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.313574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.313860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.313860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.314158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.314327 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.314483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.314640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.314801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.314961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.315124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.315285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.315438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.315595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.315748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.315748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.316042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.316204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.316355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.316530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.316682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.316834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.317009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.317162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.317313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.317479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.317639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.317804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.317975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.318128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.318128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.318415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.318669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.318836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.318997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.319171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.319333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.319635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.319794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.319954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.320122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.320275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.320444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.320612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.320765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.320916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.321082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.321246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.321409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.321560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.321711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.321871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.321871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.321871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.322305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.322455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.322614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.322775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.322941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.323100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.323260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.323420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.323572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.323736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.323896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.324048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.324199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.324357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.324580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.324747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.324900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.325052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.325203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.325365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.325525 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.325686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.325846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.325998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.326149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.326308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.326475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.326635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.326795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.326946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.327105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.327265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.327436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.327590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.327742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.327903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.328053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.328218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.328429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.328593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.329006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.329166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.329318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.329479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.329741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.329909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.330071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.330223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.330384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.330614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.330769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.330928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.331088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.331247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.331400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.331564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.331737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.331976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.332153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.332306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.332512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.332667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.332818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.332969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.332969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.332969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.333420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.333679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.333840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.333999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.334157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.334319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.334481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.334639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.334792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.334952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.335111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.335111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.335111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.335571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.335724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.335876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.336041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.336207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.336358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.336535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.336687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.336838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.337003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.337162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.337314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.337472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.337624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.337781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.337953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.338113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.338113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.338421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.338579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.338744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.338895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.339146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.339312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.339466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.339625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.339791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.339970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.340217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.340388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.340570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.340724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.340891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.341044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.341196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.341356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.341508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.341666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.341828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.341980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.342141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.342301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.342463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.342626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.342785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.342945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.343097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.343272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.343272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.343272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.343724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.343876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.344090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.344260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.344607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.344813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.345049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.345220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.345382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.345546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.345712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.345864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.346023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.346177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.346177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.346476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.346641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.346812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.346971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.347123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.347273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.347425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.347586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.347738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.347896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.348066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.348232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.348416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.348575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.348738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.348901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.349061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.349061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.349479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.349633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.349792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.349945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.350096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.350264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.350521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.350687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.350849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.351013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.351172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.351334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.351334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.351631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.351833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.351993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.352146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.352307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.352537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.352693 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.352853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.353023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.353023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.353023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.353023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.353023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.353919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.354080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.354240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.354403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.354564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.354725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.354886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.355045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.355223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.355377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.355529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.355680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.355841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.355992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.356153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.356304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.356486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.356642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.356794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.356954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.357116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.357277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.357429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.357579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.357737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.357896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.358062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.358222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.358383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.358544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.358697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.358862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.359023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.359175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.359433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.359598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.359792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.359957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.360193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.360359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.361158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.361339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.361495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.361657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.361821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.361981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.362154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.362315 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.362467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.362632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.362793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.362944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.363099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.363249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.363410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.363639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.363801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.363961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.364114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.364290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.364290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.364627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.364779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.364938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.365091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.365243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.365404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.365404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.365708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.365868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.366970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.367405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.367557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.367716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.367883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.368049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.368211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.368426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.368587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.368750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.368902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.369066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.369217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.369367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.369628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.369794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.369947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.370113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.370275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.370275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.370663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.370825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.370993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.371146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.371427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.371593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.371753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.371907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.371907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.372220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.372409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.372581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.372746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.372906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.373072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.373072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.373359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.373511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.373671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.373671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.373982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.374135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.374135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.374135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.374574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.374747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.374907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.375069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.375253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.375442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.375604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.375766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.375919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.376077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.379046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.383121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.384213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.384407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.384583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.384747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.384907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.385061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.385225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.385389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.385550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.388039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.388229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.388495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.388687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.388848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.389068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.389233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.389389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.389562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.389725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.389879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.390031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.390193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.391956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.392157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.392331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.392515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.392685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.392841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.393004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.393158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.393310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.393470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.393625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.393778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.393988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.394152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.394306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.394469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.394634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.394634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.395011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.395168 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.395322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.395493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.395493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.395790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.395957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.396119 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.396288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.399917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.399917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.399917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.400474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.400638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.400808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.400969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.401124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.401288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.401443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.401603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.401603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.401905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.402077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.402246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.402400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.402553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.402714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.402875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.403037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.403204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.403204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.403505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.403657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.403809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.403986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.404140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.404292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.404492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.404648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.404799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.404964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.405118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.405271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.405437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.405597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.405750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.405912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.406082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.406244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.406397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.406631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.406805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.407021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.407219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.407385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.407545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.407701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.407701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.408008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.408177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.408329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.408509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.408664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.408833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.408994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.408994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.409295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.409454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.409617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.409769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.409769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.409769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.410227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.410380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.410542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.410702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.410865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.411979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.412618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.412618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.412920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.413080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.413246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.413399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.413561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.413721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.413873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.414037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.414199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.414361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.414523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.414676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.414676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.414986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.414986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.415276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.415276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.415574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.415725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.415934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.416113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.416267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.416438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.416607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.416769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.416932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.417086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.418487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.418666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.418822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.418986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.419157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.419320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.419495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.419648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.419809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.419809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.419809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.420249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.420515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.420677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.420833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.420995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.421148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.421308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.421474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.421634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.421787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.423767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.423973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.424130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.424130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.424443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.424625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.424799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.424953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.425115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.425269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.425436 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.425604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.425765 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.425919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.426071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.426232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.426393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.426567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.426720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.426872 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.427023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.427184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.427355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.427523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.427720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.427885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.428604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.428785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.428952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.429116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.429272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.429425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.429577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.429731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.429893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.430060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.430214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.432511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.432737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.432939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.433114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.433276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.433442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.433607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.433761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.434004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.434004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.434316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.434471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.434740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.434740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.435056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.435211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.435371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.435533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.435533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.435841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.436006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.436158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.436318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.436559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.436724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.436880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117660) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 12:21:16.437673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.437673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.439113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.439113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.439113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.439113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.439113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.439113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.439113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.439113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.440273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.440273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.440273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.440273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.440273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.440273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.440273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.440273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.443060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.443060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.443060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.443060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.443060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.443060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.443060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.443060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.444232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.444232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.444232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.444232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.444232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.444232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.444232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.444232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.446059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.446059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.446059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.446059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.446059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.446059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.446059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.446059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.447451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.447451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.447451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.447451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.447451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.447451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.447451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.447451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.448707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.448707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.448707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.448707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.448707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.448707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.448707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.448707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.449850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.449850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.449850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.449850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.449850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.449850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.449850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.449850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.452075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.452075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.452075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.452075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.452075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.452075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.452075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.452075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.453326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.453326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.453326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.453326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.453326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.453326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.453326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.453326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.455012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.455012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.455012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.455012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.455012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.455012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.455012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.455012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.456198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.456198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.456198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.456198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.456198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.456198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.456198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.456198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.457407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.457407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.457407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.457407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.457407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.457407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.457407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.457407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.458595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.458595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.458595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.458595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.458595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.458595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.458595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.458595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.459820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.459820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.459820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.459820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.459820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.459820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.459820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.459820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.461138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.461138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.461138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.461138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.461138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.461138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.461138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.461138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.462842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.462842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.462842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.462842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:21:16.462842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 12:21:16.580855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO dbcounter [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Registered counter for database nova_api Aug 09 12:21:16.600814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:21:16.607701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writer thread running {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:21:16.617904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO dbcounter [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Registered counter for database nova_api Aug 09 12:21:16.638778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:21:16.646448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writer thread running {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:21:16.664134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.context [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1582868-d229-4f3b-a98b-d87c6e368c3b(cell1) {{(pid=117660) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 12:21:16.668182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:21:16.668674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:21:16.670233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:21:16.670947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:21:16.671389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:21:16.673519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:21:16.675671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO dbcounter [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Registered counter for database nova_cell0 Aug 09 12:21:16.679786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO dbcounter [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Registered counter for database nova_cell1 Aug 09 12:21:16.687166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:21:16.689976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:21:16.694179 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writer thread running {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:21:16.699884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writer thread running {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:21:16.702910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.context [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e1582868-d229-4f3b-a98b-d87c6e368c3b(cell1) {{(pid=117661) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 12:21:16.707081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:21:16.707558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:21:16.709151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:21:16.709896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:21:16.710339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:21:16.712313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:21:16.714363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO dbcounter [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Registered counter for database nova_cell0 Aug 09 12:21:16.719743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO dbcounter [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Registered counter for database nova_cell1 Aug 09 12:21:16.727304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:21:16.729945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:21:16.738776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writer thread running {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:21:16.740669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writer thread running {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:21:16.843053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO dbcounter [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Registered counter for database nova_cell0 Aug 09 12:21:16.850366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_db.sqlalchemy.engines [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117660) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:21:16.855403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writer thread running {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:21:16.895966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO dbcounter [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Registered counter for database nova_cell0 Aug 09 12:21:16.903568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:21:16.910495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writer thread running {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:21:17.172026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 12:21:17.179551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 12:21:17.223724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: WARNING keystonemiddleware.auth_token [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 12:21:17.231068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: WARNING keystonemiddleware.auth_token [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 12:21:17.520272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 12:21:17.526336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: WARNING keystonemiddleware.auth_token [None req-dbc8010c-7641-4d51-b0e0-d2bc14e37dff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 12:21:17.532844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563ad8b999c0 pid: 117660 (default app) Aug 09 12:21:17.575968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: WARNING keystonemiddleware.auth_token [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 12:21:17.582256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: WARNING keystonemiddleware.auth_token [None req-9bd7fec7-ff41-4693-a466-02ff28ad826e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 12:21:17.588589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563ad8b999c0 pid: 117661 (default app) Aug 09 12:21:53.184345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.185278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.186135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.187058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:54.153333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97f0a6db-b5a7-49b6-810d-5aea6b469a4c tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Action: 'create', calling method: .version_select at 0x7f0e0a2cddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2124951993"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:21:55.098143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97f0a6db-b5a7-49b6-810d-5aea6b469a4c tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.936278 Aug 09 12:21:55.098755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1155 bytes} [Tue Aug 9 12:21:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1939 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 12:21:55.215811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6c27d20-4b10-464f-9060-47a66af41c0f tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e0a149c10>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:21:55.296909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6c27d20-4b10-464f-9060-47a66af41c0f tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/c4dcbd54-6d28-42a0-a4a7-c39b127e32b8" status: 200 len: 350 microversion: 2.1 time: 0.085397 Aug 09 12:21:55.298721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 2/2] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:21:55 2022] GET /compute/v2.1/os-volumes/c4dcbd54-6d28-42a0-a4a7-c39b127e32b8 => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:21:55.498099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4f3444ad-7421-45ce-9f36-17bdbf9be2d9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a3a5940>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:21:55.534641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=3 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:55.535729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=3 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:55.537180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=3 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:55.538601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=3 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:55.882592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4f3444ad-7421-45ce-9f36-17bdbf9be2d9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e" status: 200 len: 345 microversion: 2.1 time: 0.771771 Aug 09 12:21:55.883171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1/3] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:21:55 2022] GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e => generated 345 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:21:56.923452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e8d51195-3517-4942-a5cc-f9e6fb32df23 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a15d430>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:21:57.048519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f784ee2d-4e05-41e3-b941-4b6ab9e082e1 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e0a1f6ca0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:21:57.147549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e8d51195-3517-4942-a5cc-f9e6fb32df23 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e" status: 200 len: 346 microversion: 2.1 time: 0.245349 Aug 09 12:21:57.148371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 3/4] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:21:56 2022] GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e => generated 346 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:21:57.161395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67c49ab3-7b26-4bb0-bb55-1f9499bbedb9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Action: 'create', calling method: .version_select at 0x7f0e0a15da60>, body: {"snapshot": {"volume_id": "6c9457fe-e95a-42dd-8ce7-4b8689c2761e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1757930982"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:21:57.486593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f784ee2d-4e05-41e3-b941-4b6ab9e082e1 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/2a239155-790f-4411-a4e9-067af590fa72" status: 200 len: 351 microversion: 2.1 time: 0.453000 Aug 09 12:21:57.487300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 2/5] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:21:57 2022] GET /compute/v2.1/os-volumes/2a239155-790f-4411-a4e9-067af590fa72 => generated 351 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:21:57.655336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67c49ab3-7b26-4bb0-bb55-1f9499bbedb9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.497941 Aug 09 12:21:57.655959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 4/6] 10.222.0.60 () {60 vars in 1162 bytes} [Tue Aug 9 12:21:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:21:57.668049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4d5a7a62-6ce8-4923-be77-520da74f6aba tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a1f68b0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:21:57.718510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4d5a7a62-6ce8-4923-be77-520da74f6aba tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.055662 Aug 09 12:21:57.719724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 3/7] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:21:57 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:21:57.731166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2f8644d-97e6-4635-b0b0-027b0c7317e0 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a15ddc0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:21:57.846232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2f8644d-97e6-4635-b0b0-027b0c7317e0 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.119023 Aug 09 12:21:57.847292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 5/8] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Aug 9 12:21:57 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:21:57.860232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d156e36b-d74f-40cd-bdd2-1b5cabaa0f5e tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a144430>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:21:57.951158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d156e36b-d74f-40cd-bdd2-1b5cabaa0f5e tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.096157 Aug 09 12:21:57.952425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 4/9] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:21:57 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:21:58.965594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-290a995e-9ee8-40d0-89d1-6363af4049fe tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a149af0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:21:59.025833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-290a995e-9ee8-40d0-89d1-6363af4049fe tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.064515 Aug 09 12:21:59.026399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 6/10] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:21:58 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:00.042570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6c7be025-8c28-49f1-afc2-8aa39d3eda15 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a144af0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:00.184310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6c7be025-8c28-49f1-afc2-8aa39d3eda15 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.148683 Aug 09 12:22:00.185385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 5/11] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:00 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:01.199971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d983701-55df-42d1-a789-be8b0b613540 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a164430>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:01.256139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d983701-55df-42d1-a789-be8b0b613540 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.062199 Aug 09 12:22:01.260718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 7/12] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:01 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:02.269474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-64b4850c-faa3-484e-8d0d-08498b0aeeaf tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a1521f0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:02.332430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-64b4850c-faa3-484e-8d0d-08498b0aeeaf tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.067290 Aug 09 12:22:02.333203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 6/13] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:02 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:03.347560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6b6c5716-7302-4780-a682-704814f23fe1 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a149e50>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:03.464361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6b6c5716-7302-4780-a682-704814f23fe1 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.122510 Aug 09 12:22:03.465624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 8/14] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:03 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:04.482228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-be37e85d-94ef-406b-9235-c9b4e6696163 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a1f6c10>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:04.553635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-be37e85d-94ef-406b-9235-c9b4e6696163 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 288 microversion: 2.1 time: 0.076588 Aug 09 12:22:04.560248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 7/15] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:04 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:04.593969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2df6db9f-c564-412d-84f5-e71f566f4e58 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a15d5e0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:04.787316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2df6db9f-c564-412d-84f5-e71f566f4e58 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 202 len: 0 microversion: 2.1 time: 0.225542 Aug 09 12:22:04.788257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 9/16] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Aug 9 12:22:04 2022] DELETE /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:22:04.796246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-457d7d9a-50af-408d-a164-5c63e3541db6 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a15d940>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:04.871343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-457d7d9a-50af-408d-a164-5c63e3541db6 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.079042 Aug 09 12:22:04.876362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 10/17] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:04 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:05.262327 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f51d78e8-5a52-4ddd-92a5-157b3606a7c5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: .version_select at 0x7f0e0a152160>, body: {"keypair": {"name": "tempest-keypair-261245544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfkaKVxFDQ3RbmIhEBRQ8ZZgV2XMFcZeGlw9CdvkHvFyHrESXPzT2de+niQzeM1zDwgp9KMa7XBWxBGgfDDw45xzcuRCqgB3TmatY7jQhPKEkF+SFUhYN/3xjJd1kYAVw=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:05.405278 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-f51d78e8-5a52-4ddd-92a5-157b3606a7c5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for project cffa9ae943de44bc8264914e39c80cfa. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:22:05.422125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-f51d78e8-5a52-4ddd-92a5-157b3606a7c5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for user c8982b93df5744bbbdeb7a956df06502 and project cffa9ae943de44bc8264914e39c80cfa. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:22:05.524558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f51d78e8-5a52-4ddd-92a5-157b3606a7c5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.892332 Aug 09 12:22:05.526614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 8/18] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:22:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:22:05.884450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a399e730-141b-4a1f-9c56-dd4458027925 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a149ee0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:05.932552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a399e730-141b-4a1f-9c56-dd4458027925 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.052799 Aug 09 12:22:05.933497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 11/19] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:05 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:06.948162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07aef166-0431-45cf-a3a8-3a47f7dc25a3 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e098d73a0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:07.045502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-07aef166-0431-45cf-a3a8-3a47f7dc25a3 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.103327 Aug 09 12:22:07.054853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 9/20] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:06 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:08.058656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-41728bda-7344-41b2-a1cb-d2294eb7fe70 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a15db80>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:08.142565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-41728bda-7344-41b2-a1cb-d2294eb7fe70 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.087885 Aug 09 12:22:08.143944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 12/21] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:08 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:09.163115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cdd84eed-1f54-41d9-b47f-22b9c96840c0 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a15d3a0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:09.217291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cdd84eed-1f54-41d9-b47f-22b9c96840c0 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 200 len: 287 microversion: 2.1 time: 0.065568 Aug 09 12:22:09.218826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 13/22] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:09 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:22:09.396124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3f9e926-1d20-4d64-9033-2f545037d329 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e0a1641f0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:09.478580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1762563885", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:09.519081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3f9e926-1d20-4d64-9033-2f545037d329 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/a2623161-76b3-418e-827e-e0a398a31482" status: 200 len: 351 microversion: 2.1 time: 0.126699 Aug 09 12:22:09.519899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 14/23] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:22:09 2022] GET /compute/v2.1/os-volumes/a2623161-76b3-418e-827e-e0a398a31482 => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:09.533211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8ca6ac27-6d84-487f-95a1-f79fb4b1ac23 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e0a149ca0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:09.618679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] validate_networks() for [('9c034b69-24d1-4acf-bbe5-be306b507d95', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:22:09.689824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8ca6ac27-6d84-487f-95a1-f79fb4b1ac23 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.160494 Aug 09 12:22:09.702409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 15/24] 10.222.0.60 () {58 vars in 1134 bytes} [Tue Aug 9 12:22:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:09.864269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-32e275c3-836b-4599-b001-7d2942354084 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'create', calling method: .version_select at 0x7f0e0a164d30>, body: {"keypair": {"name": "tempest-keypair-2138363039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBNdwo4ETyRU+NQeoBSC1THkf0W3zrPPpFegjCWd0sZeiSlD19C2+mJlYzZDdmQzr+ylzapD5NdSsMQFbJlObrkBS8TxQFTu7bXKehMsewbbnJSSoznG8O09wkQpJLg1Q=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:09.986976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-32e275c3-836b-4599-b001-7d2942354084 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Getting quotas for project 47b9057e7d514e6dbe0c358cce79e61a. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:22:10.005055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-32e275c3-836b-4599-b001-7d2942354084 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Getting quotas for user adadf92bd9ec48dfbb4eb5977edab923 and project 47b9057e7d514e6dbe0c358cce79e61a. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:22:10.130441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-32e275c3-836b-4599-b001-7d2942354084 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.426307 Aug 09 12:22:10.135887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 16/25] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:22:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:10.147088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea292c58-3306-4a98-b6b1-511caec0d109 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e0a13d9d0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:10.336209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea292c58-3306-4a98-b6b1-511caec0d109 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.199157 Aug 09 12:22:10.336839 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 17/26] 10.222.0.60 () {58 vars in 1149 bytes} [Tue Aug 9 12:22:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:10.341332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f020d3e1-d524-47bb-86ac-22f1948e76b8 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e0a0f8310>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:10.391324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-f020d3e1-d524-47bb-86ac-22f1948e76b8 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] HTTP exception thrown: Snapshot 00ccf513-6720-4b0a-a3fd-b35563810497 could not be found. Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f020d3e1-d524-47bb-86ac-22f1948e76b8 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Request method failure captured: Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 HTTP/1.1 Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFh4yqDnbp2g6Y6y9G4remYdrSO3EfoHOAn18k8LR7YjZR8BV-qvGvePP3cAdGpS_x2gnXTyZJRRaNYvSK1v7zq8b6uUQOTj4lyOdsyvlGb12uFC9pcLgIVH5G0VTndZNZddW1lV4EfCVLLhsWzHG7X4T3zlHn_1WWKzE4Q-T1M0ds Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 165753fa104042f4bccfdfe887c11f8c Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:22:10.395934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 165753fa104042f4bccfdfe887c11f8c Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotsTestJSON-493262768-project Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: f56389baf3d84c509fb601ac8f3d4bf8 Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotsTestJSON-493262768-project Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Snapshot 00ccf513-6720-4b0a-a3fd-b35563810497 could not be found. Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '00ccf513-6720-4b0a-a3fd-b35563810497'} Aug 09 12:22:10.397215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 00ccf513-6720-4b0a-a3fd-b35563810497 could not be found. (HTTP 404) (Request-ID: req-89b0a4ad-80a9-4f45-9b35-bfe0dfbfcd01) Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:10.398110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:22:10.399199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 00ccf513-6720-4b0a-a3fd-b35563810497 could not be found. Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 12:22:10.400288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 00ccf513-6720-4b0a-a3fd-b35563810497 could not be found. Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 00ccf513-6720-4b0a-a3fd-b35563810497 could not be found. Aug 09 12:22:10.401854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:10.403465 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f020d3e1-d524-47bb-86ac-22f1948e76b8 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Returning 404 to user: Snapshot 00ccf513-6720-4b0a-a3fd-b35563810497 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:22:10.404508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f020d3e1-d524-47bb-86ac-22f1948e76b8 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497" status: 404 len: 111 microversion: 2.1 time: 0.066653 Aug 09 12:22:10.406610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 18/27] 10.222.0.60 () {58 vars in 1251 bytes} [Tue Aug 9 12:22:10 2022] GET /compute/v2.1/os-snapshots/00ccf513-6720-4b0a-a3fd-b35563810497 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:22:10.495042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-300528435", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "networks": [{"uuid": "39cccc0b-63b7-472f-90cf-60c59a5ceeb5"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:10.612969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] validate_networks() for [('39cccc0b-63b7-472f-90cf-60c59a5ceeb5', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:22:11.534173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:22:11.535533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:22:11.536019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:22:11.536462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:22:11.536872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:22:11.577365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:11.577898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:11.578382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:11.579117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:11.581356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:11.582693 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:11.659866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Getting quotas for project eec8510663e74669969800e60e6c422b. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:22:11.677169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Getting quotas for user 7dcda8b6ba32416c86b329e2a4ee41e5 and project eec8510663e74669969800e60e6c422b. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:22:11.710839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:22:11.719602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:22:11.915077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:22:11.915555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:22:11.918439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:22:11.919620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:22:11.920515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:22:11.924280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1bf27496-5c41-4a2a-9634-d24810ff0456 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.006620 Aug 09 12:22:11.931732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 10/28] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:22:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 3017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:22:11.937858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4256a44e-7045-4a9d-b710-6e7aa6ea2357 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e09801940>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:11.962055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:11.963141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:11.963819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:11.965093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:11.965950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:11.969147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:12.001860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Getting quotas for project 25f51668a0b04e4f9e51d6356b854c7b. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:22:12.006664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Getting quotas for user ebf95a8321a249c48d1e7f0b39a067d3 and project 25f51668a0b04e4f9e51d6356b854c7b. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:22:12.037807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:22:12.042869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:22:12.222722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4256a44e-7045-4a9d-b710-6e7aa6ea2357 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.293561 Aug 09 12:22:12.223630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 11/29] 10.222.0.60 () {58 vars in 1134 bytes} [Tue Aug 9 12:22:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:12.229124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-84f06530-4958-4926-b07f-ce00e649b81c tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e09801d30>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:12.231937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1d9c0061-a4c6-460e-9b57-c0dd8c8e59f7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.814303 Aug 09 12:22:12.240874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 19/30] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:22:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:22:12.249223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ec45c60d-2e45-44dd-abd3-f75e0c426856 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:12.253435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ec45c60d-2e45-44dd-abd3-f75e0c426856 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:12.468746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-84f06530-4958-4926-b07f-ce00e649b81c tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e" status: 202 len: 0 microversion: 2.1 time: 0.243202 Aug 09 12:22:12.469701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 12/31] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:22:12 2022] DELETE /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:22:12.474634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ed71f099-7b47-4d59-adaa-71f4d1640d63 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e09801790>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:12.691097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ed71f099-7b47-4d59-adaa-71f4d1640d63 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.220203 Aug 09 12:22:12.692094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 13/32] 10.222.0.60 () {58 vars in 1167 bytes} [Tue Aug 9 12:22:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:12.703511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8f3f4b27-ca30-4875-a304-21588063812c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:12.704149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8f3f4b27-ca30-4875-a304-21588063812c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:12.725772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec45c60d-2e45-44dd-abd3-f75e0c426856 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:12.759298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ec45c60d-2e45-44dd-abd3-f75e0c426856 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1222 microversion: 2.1 time: 0.516191 Aug 09 12:22:12.768762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 20/33] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:12 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1222 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:12.787562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1033302949", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974a024c-61f1-4c3c-ba4e-fa1153d8a5d8"}], "security_groups": [{"name": "tempest-securitygroup--1360164217"}], "key_name": "tempest-keypair-261245544", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:12.995287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] validate_networks() for [('974a024c-61f1-4c3c-ba4e-fa1153d8a5d8', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:22:13.019914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8f3f4b27-ca30-4875-a304-21588063812c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:13.059225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8f3f4b27-ca30-4875-a304-21588063812c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1214 microversion: 2.1 time: 0.365908 Aug 09 12:22:13.062998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 14/34] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:12 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1214 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:13.082130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-023294f9-326f-4315-9cf6-f4a8e52dcea5 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e098d7a60>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:13.186270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-023294f9-326f-4315-9cf6-f4a8e52dcea5 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] HTTP exception thrown: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-023294f9-326f-4315-9cf6-f4a8e52dcea5 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Request method failure captured: Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e HTTP/1.1 Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFh4yqDnbp2g6Y6y9G4remYdrSO3EfoHOAn18k8LR7YjZR8BV-qvGvePP3cAdGpS_x2gnXTyZJRRaNYvSK1v7zq8b6uUQOTj4lyOdsyvlGb12uFC9pcLgIVH5G0VTndZNZddW1lV4EfCVLLhsWzHG7X4T3zlHn_1WWKzE4Q-T1M0ds Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 165753fa104042f4bccfdfe887c11f8c Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:22:13.194989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 165753fa104042f4bccfdfe887c11f8c Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotsTestJSON-493262768-project Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: f56389baf3d84c509fb601ac8f3d4bf8 Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotsTestJSON-493262768-project Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '6c9457fe-e95a-42dd-8ce7-4b8689c2761e'} Aug 09 12:22:13.196044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. (HTTP 404) (Request-ID: req-a3d7e252-d917-42b7-9e79-32319f2b4b85) Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:13.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:22:13.197964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 12:22:13.199926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-023294f9-326f-4315-9cf6-f4a8e52dcea5 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Returning 404 to user: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-023294f9-326f-4315-9cf6-f4a8e52dcea5 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e" status: 404 len: 109 microversion: 2.1 time: 0.132472 Aug 09 12:22:13.202349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 15/35] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:22:13 2022] GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:22:13.207927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-367bd9db-51c6-49d3-827b-aed6da2ee7f5 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e0aad00d0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:13.414172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-367bd9db-51c6-49d3-827b-aed6da2ee7f5 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.215634 Aug 09 12:22:13.415156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 16/36] 10.222.0.60 () {58 vars in 1170 bytes} [Tue Aug 9 12:22:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:13.428839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2054807503", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:13.573444 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] validate_networks() for [('9c034b69-24d1-4acf-bbe5-be306b507d95', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:22:15.021163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:22:15.021680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:22:15.022025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:22:15.022606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:22:15.023163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:22:15.037371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:15.040878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:15.041474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:15.042501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:15.043110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:15.043596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:15.086773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for project cffa9ae943de44bc8264914e39c80cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:22:15.100314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for user c8982b93df5744bbbdeb7a956df06502 and project cffa9ae943de44bc8264914e39c80cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:22:15.118150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:22:15.123126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:22:15.135147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:22:15.136092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:22:15.145840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:22:15.148749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:22:15.149412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:22:15.167507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:15.168670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:15.169109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:15.170282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:15.170918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:15.171336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:15.196012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6916963a-ca47-4ddb-b9d1-5ed0361daaa8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.425784 Aug 09 12:22:15.196695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 21/37] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:22:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:22:15.205607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Getting quotas for project eec8510663e74669969800e60e6c422b. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:22:15.212792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-455cb67d-91db-4ee4-bd7b-342afcce4783 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e087a24c0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:15.217841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Getting quotas for user 7dcda8b6ba32416c86b329e2a4ee41e5 and project eec8510663e74669969800e60e6c422b. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:22:15.233796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:22:15.249400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-455cb67d-91db-4ee4-bd7b-342afcce4783 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] HTTP exception thrown: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.250750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-455cb67d-91db-4ee4-bd7b-342afcce4783 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Request method failure captured: Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e HTTP/1.1 Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFh4yqDnbp2g6Y6y9G4remYdrSO3EfoHOAn18k8LR7YjZR8BV-qvGvePP3cAdGpS_x2gnXTyZJRRaNYvSK1v7zq8b6uUQOTj4lyOdsyvlGb12uFC9pcLgIVH5G0VTndZNZddW1lV4EfCVLLhsWzHG7X4T3zlHn_1WWKzE4Q-T1M0ds Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 165753fa104042f4bccfdfe887c11f8c Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:22:15.252895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 165753fa104042f4bccfdfe887c11f8c Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotsTestJSON-493262768-project Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: f56389baf3d84c509fb601ac8f3d4bf8 Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotsTestJSON-493262768-project Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '6c9457fe-e95a-42dd-8ce7-4b8689c2761e'} Aug 09 12:22:15.254260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. (HTTP 404) (Request-ID: req-0ccdef28-4318-47b3-b3fe-8b79d9c67ac5) Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:15.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 12:22:15.256673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 12:22:15.257804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.258913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.260417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-455cb67d-91db-4ee4-bd7b-342afcce4783 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Returning 404 to user: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:22:15.261431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-455cb67d-91db-4ee4-bd7b-342afcce4783 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e" status: 404 len: 109 microversion: 2.1 time: 0.052572 Aug 09 12:22:15.262137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 22/38] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:22:15 2022] DELETE /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:22:15.268876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c482c8b4-f1dc-487d-86bf-95a675b9c281 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e0a0f8700>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:15.370413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-85cb93be-d2a8-4b4f-be29-7a11e3fbfb34 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.953610 Aug 09 12:22:15.383222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 17/39] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:22:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:22:15.398439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:15.402490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:15.407034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c482c8b4-f1dc-487d-86bf-95a675b9c281 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.143688 Aug 09 12:22:15.416566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 23/40] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Aug 9 12:22:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:15.422043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-54120cd0-018f-4fe5-8692-606195727761 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:15.423177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-54120cd0-018f-4fe5-8692-606195727761 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:15.423509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:15.424022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:15.427457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:15.428329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:15.429426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:15.430229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:15.580021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-54120cd0-018f-4fe5-8692-606195727761 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:15.600716 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-54120cd0-018f-4fe5-8692-606195727761 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1241 microversion: 2.1 time: 0.181114 Aug 09 12:22:15.634561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 24/41] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:15 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1241 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:15.658527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f1a449ad-0950-4327-9153-4331e99792a9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Calling method '.version_select at 0x7f0e087b9820>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:15.685786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:15.700455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-47526db5-82b6-43c7-8eae-aa9c351f5485 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1210 microversion: 2.1 time: 0.315365 Aug 09 12:22:15.701808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 18/42] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:15 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1210 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:15.717597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0bbda07e-4b3c-42af-9ebd-83764af80534 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:15.718102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0bbda07e-4b3c-42af-9ebd-83764af80534 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:15.724962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-f1a449ad-0950-4327-9153-4331e99792a9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] HTTP exception thrown: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f1a449ad-0950-4327-9153-4331e99792a9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Request method failure captured: Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e HTTP/1.1 Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFh4yqDnbp2g6Y6y9G4remYdrSO3EfoHOAn18k8LR7YjZR8BV-qvGvePP3cAdGpS_x2gnXTyZJRRaNYvSK1v7zq8b6uUQOTj4lyOdsyvlGb12uFC9pcLgIVH5G0VTndZNZddW1lV4EfCVLLhsWzHG7X4T3zlHn_1WWKzE4Q-T1M0ds Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 165753fa104042f4bccfdfe887c11f8c Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:22:15.726788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/165753fa104042f4bccfdfe887c11f8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 165753fa104042f4bccfdfe887c11f8c Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-493262768 Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotsTestJSON-493262768-project Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: f56389baf3d84c509fb601ac8f3d4bf8 Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotsTestJSON-493262768-project Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '6c9457fe-e95a-42dd-8ce7-4b8689c2761e'} Aug 09 12:22:15.727895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. (HTTP 404) (Request-ID: req-733df80f-496e-43b5-8d02-e911c248d18b) Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:15.728587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:22:15.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 12:22:15.730769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f1a449ad-0950-4327-9153-4331e99792a9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] Returning 404 to user: Volume 6c9457fe-e95a-42dd-8ce7-4b8689c2761e could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f1a449ad-0950-4327-9153-4331e99792a9 tempest-VolumesSnapshotsTestJSON-493262768 tempest-VolumesSnapshotsTestJSON-493262768-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e" status: 404 len: 109 microversion: 2.1 time: 0.091731 Aug 09 12:22:15.731932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 25/43] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:22:15 2022] GET /compute/v2.1/os-volumes/6c9457fe-e95a-42dd-8ce7-4b8689c2761e => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:22:15.739035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fcb9dbbe-88e3-4c43-9baf-d3f2db28a481 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e087abca0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:15.810484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0bbda07e-4b3c-42af-9ebd-83764af80534 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:15.818811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0bbda07e-4b3c-42af-9ebd-83764af80534 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1222 microversion: 2.1 time: 0.115296 Aug 09 12:22:15.820778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 19/44] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:15 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:15.826042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-142114936", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c4878ee-21b0-4343-817f-c1d4db76ce5f"}], "security_groups": [{"name": "tempest-securitygroup--331887016"}], "key_name": "tempest-keypair-2138363039", "user_data": "}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:16.006278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fcb9dbbe-88e3-4c43-9baf-d3f2db28a481 tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.272658 Aug 09 12:22:16.007338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 26/45] 10.222.0.60 () {58 vars in 1188 bytes} [Tue Aug 9 12:22:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:16.023460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d6be5db-b278-49d1-81a9-61953781efad tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] Calling method '.version_select at 0x7f0e0877ff70>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:16.055173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] validate_networks() for [('3c4878ee-21b0-4343-817f-c1d4db76ce5f', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:22:16.228922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d6be5db-b278-49d1-81a9-61953781efad tempest-VolumesTestJSON-909358987 tempest-VolumesTestJSON-909358987-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.210155 Aug 09 12:22:16.229744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 27/46] 10.222.0.60 () {58 vars in 1155 bytes} [Tue Aug 9 12:22:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:16.632155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:22:16.632774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:22:16.633249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:22:16.633653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:22:16.634205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:22:16.643556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:16.644188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:16.644655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:16.645376 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:16.645939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:16.646525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:16.659867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:16.660664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:16.669124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Getting quotas for project 47b9057e7d514e6dbe0c358cce79e61a. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:22:16.671902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:16.674427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Getting quotas for user adadf92bd9ec48dfbb4eb5977edab923 and project 47b9057e7d514e6dbe0c358cce79e61a. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:22:16.675978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:16.678914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:16.679780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:16.680632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:16.682257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:16.690465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:22:16.694306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:22:16.771232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8eb1a20b-9e6f-434d-a743-2e23b41fab08 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.949117 Aug 09 12:22:16.772619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 20/47] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:22:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:22:16.779825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:16.780951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:16.788295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:16.789158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:16.789819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:16.791938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:16.792731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:16.793363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:17.022996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:17.026850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:17.034700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-558a8859-1294-4a1a-afad-10918408a7e9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1210 microversion: 2.1 time: 0.260750 Aug 09 12:22:17.035280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 21/48] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:16 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1210 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:17.039201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70e8d784-6b49-467c-8033-e5eb8c7c2b68 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1245 microversion: 2.1 time: 0.384627 Aug 09 12:22:17.040460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 28/49] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:16 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1245 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:17.056416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:17.057048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:17.061182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c5b4ef11-a47c-4f90-bbbd-00535dff59b0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:17.063816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c5b4ef11-a47c-4f90-bbbd-00535dff59b0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:17.070715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:17.076189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:17.076815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:17.078625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:17.081252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:17.081906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:17.189190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c5b4ef11-a47c-4f90-bbbd-00535dff59b0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:17.195898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c5b4ef11-a47c-4f90-bbbd-00535dff59b0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1237 microversion: 2.1 time: 0.147145 Aug 09 12:22:17.197043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 22/50] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:17 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1237 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:17.223129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:17.243328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73d34de5-03eb-4d2e-8054-ee6a729592c2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1226 microversion: 2.1 time: 0.201588 Aug 09 12:22:17.245417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 29/51] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:17 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1226 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:18.054973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:18.055700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:18.061048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:18.061689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:18.061813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:18.062175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:18.062607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:18.063438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:18.063743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:18.064156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:18.069324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:18.069717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:18.070346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:18.071174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:18.071629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:18.072079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:18.138219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:18.147326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-17b5ab38-bf71-4843-b1bd-f4a818bad560 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1210 microversion: 2.1 time: 0.096177 Aug 09 12:22:18.147909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 23/52] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:18 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:18.161084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:18.168563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42513478-0547-4ae2-a440-31eb586493e1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1245 microversion: 2.1 time: 0.112556 Aug 09 12:22:18.169130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 30/53] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:18 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:18.222253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:18.223063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:18.229302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:18.229824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:18.230254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:18.230937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:18.231463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:18.231813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:18.267724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:18.268359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:18.274787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:18.275657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:18.276876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:18.278780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:18.279585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:18.280391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:18.345177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:18.354835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ed3662e7-19b0-4836-88ba-d205178262aa tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1241 microversion: 2.1 time: 0.136438 Aug 09 12:22:18.355436 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 24/54] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:18 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:18.375560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:18.385068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-005040be-12ae-402b-a547-939fb49bc741 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1226 microversion: 2.1 time: 0.122693 Aug 09 12:22:18.385750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 31/55] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:18 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1226 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:19.182501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:19.183117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:19.190528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:19.191818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:19.200274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:19.200274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:19.200990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:19.201599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:19.202162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:19.202310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:19.203059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:19.203653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:19.203944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:19.204421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:19.205136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:19.209625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:19.294819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:19.308013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e184cba1-8e88-4150-bb93-e17efae9ac4b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1293 microversion: 2.1 time: 0.121861 Aug 09 12:22:19.311440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 32/56] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:19 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1293 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:19.348775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:19.356603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d8f70ed9-9b84-4871-ad7c-b43db52bb122 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1274 microversion: 2.1 time: 0.191819 Aug 09 12:22:19.357229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 25/57] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:19 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:19.378141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:19.378987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:19.386207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:19.386923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:19.387556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:19.393174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:19.393883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:19.394477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:19.407958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:19.409139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:19.416125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:19.416923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:19.417718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:19.418657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:19.419294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:19.419986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:19.584691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:19.597292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-25a20c25-3aea-424a-8cc5-ee79691f54bc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1289 microversion: 2.1 time: 0.223646 Aug 09 12:22:19.598539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 33/58] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:19 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1289 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:19.620139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:19.648851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ee46593e-f3b2-4f6f-8ad0-d6e9b37ee522 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1274 microversion: 2.1 time: 0.246454 Aug 09 12:22:19.649286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 26/59] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:19 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1274 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:20.333310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:20.334693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:20.343930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:20.346561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:20.347018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:20.347733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:20.348186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:20.348714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:20.378800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:20.379759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:20.391036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:20.397369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:20.397930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:20.399252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:20.405287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:20.405774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:21.217703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:21.226517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b3c04d87-8869-4a47-8f94-6a5324e9c383 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1293 microversion: 2.1 time: 0.897912 Aug 09 12:22:21.227107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 34/60] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:20 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1293 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:21.238376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:21.243364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:21.260770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:21.261488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:21.262111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:21.263002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:21.266343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:21.267037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:21.435724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:21.446254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2157e221-8ce7-445f-ba95-b18697d7caf5 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1272 microversion: 2.1 time: 1.071562 Aug 09 12:22:21.464470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 27/61] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:20 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1272 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:21.466893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:21.468581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:21.497359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:21.498237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:21.502203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:21.503622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:21.507730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:21.508529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:21.700025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:21.750538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44fe5d50-431d-419d-b208-550f322950c1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1295 microversion: 2.1 time: 0.518140 Aug 09 12:22:21.786190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 35/62] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:21 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1295 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:22.164760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:22.185195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-19dbf830-c9f5-4050-b293-bde9c1ac07b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1280 microversion: 2.1 time: 0.728346 Aug 09 12:22:22.217143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 28/63] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:21 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1280 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:22.248102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:22.249122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:22.269137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:22.273197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:22.277630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:22.284868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:22.288197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:22.290346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:22.481029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:22.482341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:22.492262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:22.493183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:22.501172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:22.504267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:22.506917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:22.507671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:22.606164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:22.625142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6830959b-3e75-4abd-906f-ddcae851af03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1299 microversion: 2.1 time: 0.379119 Aug 09 12:22:22.642360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 36/64] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:22 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1299 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:22.744140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:22.755024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01432857-005b-46ee-9a39-c4b008c7ee3a tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1272 microversion: 2.1 time: 0.279074 Aug 09 12:22:22.766213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 29/65] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:22 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:22.784018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:22.785310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:22.799617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:22.802837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:22.804134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:22.805235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:22.813811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:22.814999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:23.020977 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:23.032929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-352a6ff4-edb6-43cd-933e-e3b550ab6461 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1295 microversion: 2.1 time: 0.252545 Aug 09 12:22:23.033530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 37/66] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:22 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1295 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:23.217845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:23.218757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:23.227358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:23.232175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:23.232913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:23.233903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:23.235748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:23.236892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:23.547293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:23.559438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bf40bd6a-418f-41f8-8b90-18aa87732832 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1280 microversion: 2.1 time: 0.346129 Aug 09 12:22:23.582111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 30/67] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:23 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1280 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:23.649514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:23.650500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:23.658913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:23.665760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:23.686653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:23.686653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:23.686653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:23.686653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:23.784990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:23.785773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:23.794630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:23.799000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:23.799764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:23.800944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:23.801630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:23.802460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:25.055720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:25.202029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:25.215169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a9f8a25d-1667-4834-a832-b9e0a8b4bddf tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 1.433927 Aug 09 12:22:25.218943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:25.233913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-23e7b945-b22e-493d-b88a-9f1b3ae753f3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 1.585925 Aug 09 12:22:25.234787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 31/68] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:23 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:25.236986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 38/69] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:23 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:25.255912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:25.256793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:25.257288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:25.258084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:25.293030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:25.295797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:25.296455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:25.297266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:25.297942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:25.298059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:25.299073 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:25.299738 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:25.300409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:25.301245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:25.302575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:25.303102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:25.588920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=20 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:26.149053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:26.164981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb9e4b98-602d-43f2-abaa-58b6a037a059 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1280 microversion: 2.1 time: 0.926252 Aug 09 12:22:26.165880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 39/70] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:25 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1280 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:26.174627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:26.183624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-161ec25a-decd-4741-b151-530e4edcd725 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1295 microversion: 2.1 time: 0.945727 Aug 09 12:22:26.185105 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 32/71] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:25 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1295 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:26.253877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:26.255114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:26.267408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:26.268748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:26.271962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:26.275628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:26.280205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:26.285183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:26.285904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:26.286684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:26.287609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:26.288294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:26.289801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:26.289801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:26.290993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:26.297552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:26.298133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:26.659441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=6 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:27.193836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=28 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:27.257576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:27.271573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:27.293976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a82957a3-18e8-4473-8e6e-7fa47c6ad88e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 1.030561 Aug 09 12:22:27.294713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 33/72] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:26 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:27.316907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-41857379-4be2-4cb9-b8ae-2a6cf6619881 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 1.016573 Aug 09 12:22:27.323260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 40/73] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:26 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:27.341030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:27.343187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:27.351968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:27.352795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:27.353699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:27.354906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:27.355585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:27.356228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:27.749757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-f4fa5deb-3a29-4ba9-8a70-fd8b2324b307 req-07ac307f-9592-440f-9658-cf914a657d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d211a1bb-283d-49db-bd1d-b2a7c0d5a691", "tag": "0a231768-1ff2-45d4-a810-69f36326fa79"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:27.806213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-f4fa5deb-3a29-4ba9-8a70-fd8b2324b307 req-07ac307f-9592-440f-9658-cf914a657d9b service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:27.806691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-f4fa5deb-3a29-4ba9-8a70-fd8b2324b307 req-07ac307f-9592-440f-9658-cf914a657d9b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:27.807185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-f4fa5deb-3a29-4ba9-8a70-fd8b2324b307 req-07ac307f-9592-440f-9658-cf914a657d9b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:27.837774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-f4fa5deb-3a29-4ba9-8a70-fd8b2324b307 req-07ac307f-9592-440f-9658-cf914a657d9b service nova] Creating event network-changed:0a231768-1ff2-45d4-a810-69f36326fa79 for instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 on hv-cinder-85236 Aug 09 12:22:27.838304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-f4fa5deb-3a29-4ba9-8a70-fd8b2324b307 req-07ac307f-9592-440f-9658-cf914a657d9b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 12:22:27.838689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-f4fa5deb-3a29-4ba9-8a70-fd8b2324b307 req-07ac307f-9592-440f-9658-cf914a657d9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 12:22:27.847918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:27.848468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:27.849079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:27.850163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:27.850761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:27.851336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:27.861755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.compute.rpcapi [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 12:22:27.863226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] Releasing lock "compute-rpcapi-router" {{(pid=117661) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 12:22:27.902237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-47723bfe-7e5b-494d-82c9-182a3ebe5207 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.576340 Aug 09 12:22:27.906189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 34/74] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:27.922264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:27.923157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:27.931641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:27.932640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:27.933377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:27.934227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:27.935161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:27.935727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:28.647980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:28.660892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-563899dc-1b34-4f1d-a055-eff05dbf526c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.753226 Aug 09 12:22:28.692917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 35/75] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:27 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:28.694823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:28.695451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:28.707695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:28.708184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:28.708660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:28.720675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:28.721478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:28.722098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:28.769983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:28.784772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e07d9aa6-d00c-4415-ab7d-f177fee06b6f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 1.460416 Aug 09 12:22:28.785929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 41/76] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:27 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:28.790651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:28.806573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:28.813595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:28.825181 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:28.825978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:28.827004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:28.827635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:28.828206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:29.790933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:29.804342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:29.811625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d0360de-1ae1-45cd-9362-5a6345f585cc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 1.120536 Aug 09 12:22:29.814738 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 36/77] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:28 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:29.825084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:29.826514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:29.846083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:29.846750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:29.848462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:29.849384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:29.850534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:29.852766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:30.122863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:30.140661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e50f2408-5c52-4faf-bacc-cdad925a3276 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 1.353458 Aug 09 12:22:30.142799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 42/78] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:28 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:30.155305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:30.158310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:30.171419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:30.172822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:30.173839 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:30.176122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:30.177202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:30.177862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:30.784000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:30.807969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-80976aa0-6411-450f-ae39-8f72deebe48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.990524 Aug 09 12:22:30.809427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 37/79] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:29 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:30.825157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-de1f63c5-d23b-4570-9f2f-cbbc27e7e80d req-82a68923-5c44-44b8-864c-401eaa146191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f547825d-c0f5-40e7-8788-3a519b56ae51", "tag": "e12c36b3-adeb-4a4c-aa0d-1173e5045ba9"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:30.857182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-de1f63c5-d23b-4570-9f2f-cbbc27e7e80d req-82a68923-5c44-44b8-864c-401eaa146191 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:30.858924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-de1f63c5-d23b-4570-9f2f-cbbc27e7e80d req-82a68923-5c44-44b8-864c-401eaa146191 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:30.859562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-de1f63c5-d23b-4570-9f2f-cbbc27e7e80d req-82a68923-5c44-44b8-864c-401eaa146191 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:30.900049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-de1f63c5-d23b-4570-9f2f-cbbc27e7e80d req-82a68923-5c44-44b8-864c-401eaa146191 service nova] Creating event network-changed:e12c36b3-adeb-4a4c-aa0d-1173e5045ba9 for instance f547825d-c0f5-40e7-8788-3a519b56ae51 on hv-cinder-85236 Aug 09 12:22:30.917816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-de1f63c5-d23b-4570-9f2f-cbbc27e7e80d req-82a68923-5c44-44b8-864c-401eaa146191 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104626 Aug 09 12:22:30.919069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 38/80] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:30.935552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:30.937506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:30.956429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:30.957914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:30.959764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:30.960769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:30.962083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:30.964287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:31.151001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:31.155804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:31.167192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c707d83b-43e0-4062-8aa2-36943df47d07 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 1.021346 Aug 09 12:22:31.171001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 43/81] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:30 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:31.177265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:31.178230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:31.205757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:31.207983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:31.208681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:31.210250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:31.212961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:31.215134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:31.981214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:31.992169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-22fc0619-7e6c-4d6e-a68d-0cc42bee9e9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 1.068753 Aug 09 12:22:31.997347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 39/82] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:30 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:32.012614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:32.013156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:32.014533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:32.024078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d671879-ad5b-41a3-91c7-7c7baca2a5ef tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.851725 Aug 09 12:22:32.029100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 44/83] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:31 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:32.032657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:32.033341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:32.033932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:32.034795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:32.039611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:32.040273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:32.191216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:32.191859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:32.204254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:32.212451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:32.213206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:32.217633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:32.218664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:32.221503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:32.575005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:32.588881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ba96d9ee-626f-488a-855d-2a259a5a4270 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.588218 Aug 09 12:22:32.589700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 40/84] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:31 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:32.686512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:32.699022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4374050-7f70-4cda-992e-76dae8d48ac8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.511628 Aug 09 12:22:32.700056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 45/85] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:32 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:33.024212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:33.025311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:33.032984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.033663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.034097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.034997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.035943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.036829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.128837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-8f229bc9-c225-4a7a-9ac6-b931867b6097 req-7c9c7282-e4bf-412d-b146-03332a768785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "138f9e3b-bbbe-4ef3-9108-e66e8911f81c", "tag": "77debbd0-dda5-40b2-9a29-5390ecf3a5ec"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:33.153242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-8f229bc9-c225-4a7a-9ac6-b931867b6097 req-7c9c7282-e4bf-412d-b146-03332a768785 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.153856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-8f229bc9-c225-4a7a-9ac6-b931867b6097 req-7c9c7282-e4bf-412d-b146-03332a768785 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.154350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-8f229bc9-c225-4a7a-9ac6-b931867b6097 req-7c9c7282-e4bf-412d-b146-03332a768785 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.175307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-8f229bc9-c225-4a7a-9ac6-b931867b6097 req-7c9c7282-e4bf-412d-b146-03332a768785 service nova] Creating event network-changed:77debbd0-dda5-40b2-9a29-5390ecf3a5ec for instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c on hv-cinder-85236 Aug 09 12:22:33.188915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-8f229bc9-c225-4a7a-9ac6-b931867b6097 req-7c9c7282-e4bf-412d-b146-03332a768785 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389807 Aug 09 12:22:33.191345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 41/86] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:33.204993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:33.206864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:33.223768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.224269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.226187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.228296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.230199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.231639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.361520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:33.376449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cfb0ef12-bb79-4eeb-8e4e-4a64b289fb5f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.356317 Aug 09 12:22:33.378814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 46/87] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:33 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:33.426641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:33.435370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ceae712-4895-4080-901a-55731c6867aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.242648 Aug 09 12:22:33.436169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 42/88] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:33 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:33.612039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:33.612763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:33.615890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:33.619762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.620237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.620695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.621383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.621876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.622430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.719879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:33.720687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:33.728491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.729162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.729590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.730283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:33.730719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:33.731133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:33.827518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:33.838711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2acd4a9-c312-4f59-998c-8369678fed6a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.229376 Aug 09 12:22:33.839400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 47/89] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:33 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:33.902094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:33.910640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a2ad04c7-40bc-48f0-bddd-735f279ae0d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.194731 Aug 09 12:22:33.911317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 43/90] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:33 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:34.404175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:34.405107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:34.415473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:34.416370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:34.417056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:34.418344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:34.419316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:34.420191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:34.459797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:34.469530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:34.477403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:34.478731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:34.479345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:34.480061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:34.480859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:34.481319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:34.635819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:34.643921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81610d90-c8b8-4348-b4da-da5f9c17d47e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.246592 Aug 09 12:22:34.657456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 48/91] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:34 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:34.692877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:34.701358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a2ed2b6f-22ff-4b5c-bdfe-66cc79890dac tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.247238 Aug 09 12:22:34.701950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 44/92] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:34 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:34.861311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:34.862171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:34.868114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:34.868701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:34.869223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:34.869999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:34.870506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:34.870985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:34.935008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:34.935613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:34.941904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:34.942386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:34.942818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:34.943886 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:34.944530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:34.944952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:35.136805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:35.144761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-115ef062-34d8-4377-a9ab-4979437a7082 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.288068 Aug 09 12:22:35.145336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 49/93] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:34 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:35.198842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:35.208782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c1f7543-6e26-4259-a4ce-e1d46fe82ba5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.281236 Aug 09 12:22:35.209681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 45/94] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:34 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:35.220577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-ba27ce89-afaa-4bad-b603-e1f009128875 req-ae9e4092-bf08-41c0-a322-7e7ddeaa4967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56388ec4-a642-4d87-a2a1-da60a5c0f9f5", "tag": "cdeb0c4e-c7ea-4941-a99c-2b329d11b818"}, {"name": "network-changed", "server_uuid": "15a239bb-d81f-4ad7-b084-b2be4d75426d", "tag": "4907d57d-ce20-40f7-9bb0-68e03189ce29"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:35.235874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ba27ce89-afaa-4bad-b603-e1f009128875 req-ae9e4092-bf08-41c0-a322-7e7ddeaa4967 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:35.236581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ba27ce89-afaa-4bad-b603-e1f009128875 req-ae9e4092-bf08-41c0-a322-7e7ddeaa4967 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:35.237282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ba27ce89-afaa-4bad-b603-e1f009128875 req-ae9e4092-bf08-41c0-a322-7e7ddeaa4967 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:35.263713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-ba27ce89-afaa-4bad-b603-e1f009128875 req-ae9e4092-bf08-41c0-a322-7e7ddeaa4967 service nova] Creating event network-changed:cdeb0c4e-c7ea-4941-a99c-2b329d11b818 for instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 on hv-cinder-85236 Aug 09 12:22:35.264427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-ba27ce89-afaa-4bad-b603-e1f009128875 req-ae9e4092-bf08-41c0-a322-7e7ddeaa4967 service nova] Creating event network-changed:4907d57d-ce20-40f7-9bb0-68e03189ce29 for instance 15a239bb-d81f-4ad7-b084-b2be4d75426d on hv-cinder-85236 Aug 09 12:22:35.264958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ba27ce89-afaa-4bad-b603-e1f009128875 req-ae9e4092-bf08-41c0-a322-7e7ddeaa4967 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 12:22:35.265345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ba27ce89-afaa-4bad-b603-e1f009128875 req-ae9e4092-bf08-41c0-a322-7e7ddeaa4967 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 12:22:35.266487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:35.266933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:35.267526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:35.268225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:35.268696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:35.269104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:35.281945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.compute.rpcapi [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 12:22:35.283166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117660) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 12:22:35.303532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e9eef391-2fb2-4e6c-a45a-85257e77d6f8 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086696 Aug 09 12:22:35.304335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 50/95] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:35.665463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:35.666194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:35.674547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:35.675095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:35.675495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:35.676367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:35.676842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:35.677255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:35.723095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:35.723795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:35.732015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:35.732533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:35.733082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:35.733782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:35.734236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:35.734691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:35.869313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:35.887110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6b7aea1-7664-4230-9057-4a710c840c02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.225594 Aug 09 12:22:35.888129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 46/96] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:35 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:35.905443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:35.913328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8887f3c-a59b-457c-bfb5-8edd0faf1ffe tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.194635 Aug 09 12:22:35.913891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 51/97] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:35 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:36.165473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:36.166245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:36.173150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:36.173639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:36.174159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:36.175103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:36.175472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:36.175890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:36.228955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:36.229840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:36.236717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:36.237395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:36.237985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:36.238831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:36.239456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:36.240023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:36.345708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:36.353163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c971f10c-9815-4d45-88b6-8c30ec826972 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.191540 Aug 09 12:22:36.353916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 47/98] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:36 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:36.404942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:36.414864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f4c5e871-a887-415d-bbed-e20bf6a1d3b4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.187701 Aug 09 12:22:36.415449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 52/99] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:36 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:36.908942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:36.909537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:36.915716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:36.916192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:36.916638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:36.917319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:36.917759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:36.918195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:36.935865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:36.937325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:36.943133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:36.943726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:36.944307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:36.945184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:36.945636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:36.946056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:37.127699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:37.131474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:37.136230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b35a4917-2ea6-460f-968b-ace07cde2752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.231100 Aug 09 12:22:37.136840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 48/100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:36 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:37.148578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81b4b116-ccb2-44b6-82e6-f912bfd8ce8d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.209286 Aug 09 12:22:37.149629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 53/101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:36 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:37.375283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:37.375956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:37.382641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:37.383123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:37.383750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:37.384474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:37.384925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:37.385417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:37.435439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:37.436072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:37.442207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:37.442695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:37.443151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:37.443832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:37.444257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:37.444942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:37.564703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:37.572535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-159f1cae-9bc3-447e-9d05-580e8eaad685 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.201144 Aug 09 12:22:37.573386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 49/102] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:37 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:37.612529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:37.620135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e922d987-6f8f-4910-bc67-aaca0e3bcc04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.188748 Aug 09 12:22:37.620936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 54/103] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:37 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:38.155675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:38.160777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:38.161396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:38.163360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:38.164680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:38.171301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:38.171792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:38.174993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:38.175888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:38.178118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:38.180144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:38.198541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:38.201209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:38.201562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:38.202458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:38.203067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:38.203632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:38.629950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:38.638066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8764eb27-ed29-4731-87ff-e7e02eb93b8e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.480972 Aug 09 12:22:38.638752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 55/104] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:38 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:38.643194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:38.643789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:38.651562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:38.653857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:38.654537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:38.654992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:38.655683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:38.656124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:38.656620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:38.659483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1c1df4e0-bc26-4972-8315-0d0b265e0e76 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.505175 Aug 09 12:22:38.660058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 50/105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:38 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:38.664568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:38.665339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:38.671438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:38.672082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:38.672689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:38.673562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:38.674012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:38.674430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:39.031209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:39.035642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:39.043300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7cb7d349-373e-48cc-bc35-93bb8b4adfca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.382210 Aug 09 12:22:39.043841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 51/106] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:38 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:39.050889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f8bdc08-c7e1-4436-973f-0a41b13e7d69 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.411074 Aug 09 12:22:39.051466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 56/107] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:38 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:39.660564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:39.661133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:39.667890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:39.668407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:39.668904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:39.669819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:39.670281 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:39.670714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:39.680616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:39.681241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:39.688362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:39.688893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:39.689364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:39.690163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:39.690687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:39.691171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:39.870371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:39.875416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:39.880799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3775d70-7813-4931-9e4a-53e016606c71 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.224428 Aug 09 12:22:39.894323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 52/108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:39 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:39.895041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-151eebad-f605-4715-897b-e29f10cf0d0a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.209030 Aug 09 12:22:39.895041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 57/109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:39 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:40.069742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:40.070986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:40.075024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:40.075985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:40.079433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:40.080001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:40.080567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:40.081316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:40.081879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:40.082089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:40.082592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:40.082792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:40.083049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:40.083878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:40.084344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:40.084787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:40.275935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:40.279565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:40.284518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2845bca5-a650-4ef4-9c0c-e925fe04b191 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.222153 Aug 09 12:22:40.285253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 53/110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:40 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:40.287446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5c7337b7-4c18-4024-a78a-726a02d8b146 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.218651 Aug 09 12:22:40.288170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 58/111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:40 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:40.903222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:40.904412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:40.906802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:40.907410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:40.911042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:40.911521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:40.911949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:40.912975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:40.913185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:40.913599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:40.913752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:40.914230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:40.914618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:40.915331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:40.915771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:40.916187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:41.116692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:41.117950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:41.121378 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:41.124794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7dad7821-2318-47fe-8ce1-074d6d47703d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.222262 Aug 09 12:22:41.125389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 59/112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:40 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:41.125893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d34a3a8d-d120-40fb-8a20-4128f2ba231d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.227490 Aug 09 12:22:41.126526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 54/113] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:40 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:41.306915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:41.307519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:41.308187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:41.308828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:41.314266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:41.314779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:41.315187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:41.315547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:41.316027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:41.316124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:41.316484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:41.316751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:41.317164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:41.317267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:41.317605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:41.318018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:41.525956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:41.529500 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:41.530294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:41.535760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d7d1585-41e0-4f24-a3dd-2d58899b781b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.232852 Aug 09 12:22:41.537192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 60/114] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:41 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:41.537315 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fcac4733-5ceb-4cc2-a969-861dc2243f4a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.233223 Aug 09 12:22:41.538106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 55/115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:41 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:42.147163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:42.147753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:42.148216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:42.148296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:42.155445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:42.155928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:42.156352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:42.157094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:42.157542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:42.157958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:42.158458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:42.158948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:42.159373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:42.160065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:42.160535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:42.160951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:42.352226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:42.354760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:42.360648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b2d26b38-f64b-4353-88a8-de64b9c2fda7 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.217263 Aug 09 12:22:42.361235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 56/116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:42 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:42.362557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0fed726b-41f3-4e44-a02d-14758028466e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.219866 Aug 09 12:22:42.363618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 61/117] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:42 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:42.557541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:42.558056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:42.558207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:42.558765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:42.564856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:42.565035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:42.565338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:42.565480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:42.565868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:42.566019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:42.566557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:42.566690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:42.567003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:42.567137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:42.567422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:42.567555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:42.779514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:42.787428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6f7c68c1-d4b1-45a9-966d-5c7f391c3bd3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.234221 Aug 09 12:22:42.788002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 57/118] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:42 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:42.791423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:42.799594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-48d8b1da-8989-472c-a548-0fd8ef79b94c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.245944 Aug 09 12:22:42.800131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 62/119] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:42 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:43.381907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:43.382552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:43.383388 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:43.384001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:43.389316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:43.389851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:43.390170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:43.390859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:43.391305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:43.392020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:43.392501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:43.392831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:43.392956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:43.393706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:43.394172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:43.394966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:43.588501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:43.595671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:43.596972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca24c60a-7e36-499b-acdd-dcd6eb773d6a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.217735 Aug 09 12:22:43.597542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 63/120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:43 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:43.605189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4fc465f3-7b4d-47c3-aac6-d22b0a5ca57f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.227663 Aug 09 12:22:43.605757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 58/121] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:43 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:43.812830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:43.813807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:43.823622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:43.824438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:43.825152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:43.825932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:43.826189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:43.826538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:43.826682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:43.827051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:43.832941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:43.833414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:43.833874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:43.834653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:43.835093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:43.835507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:44.020000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:44.024245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:44.029166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ac9b4dcf-2c01-47d2-9fbf-b4964d546aa2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.210773 Aug 09 12:22:44.029884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 59/122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:43 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:44.033452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4b6a265a-def8-475d-bc40-fdecfa5a4a6a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.226994 Aug 09 12:22:44.034152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 64/123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:43 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:44.618136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:44.618698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:44.625115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:44.625592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:44.626014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:44.626694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:44.627136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:44.627432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:44.627892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:44.628683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:44.636256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:44.636823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:44.637299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:44.638003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:44.638528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:44.638952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:44.824263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:44.828477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:44.832328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9d9aac08-8505-4cac-ba9f-cd7169d8e61e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.217920 Aug 09 12:22:44.833169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 60/124] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:44 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:44.836173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6f780fb-6ff5-40a5-bb84-b5ab56e9ffb6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.213698 Aug 09 12:22:44.836799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 65/125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:44 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:45.054223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:45.055259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:45.058946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:45.060221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:45.064571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:45.065131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:45.065726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:45.066533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:45.067180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:45.067297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:45.067431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:45.067869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:45.068389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:45.069189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:45.069725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:45.070207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:45.267158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:45.270254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:45.276284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f563fd55-5d9b-46d9-b5ed-2b3d912ea57d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.228654 Aug 09 12:22:45.277074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 61/126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:45 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:45.280497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e277a1b8-0e47-42b5-9fad-16f6349bbcef tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.228580 Aug 09 12:22:45.281065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 66/127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:45 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:45.858561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:45.859146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:45.859427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:45.860022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:45.861888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:45.865882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:45.866372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:45.866816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:45.867265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:45.867499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:45.867828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:45.867974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:45.868244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:45.868422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:45.868969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:45.869399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:45.869829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:46.062933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:46.066937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:46.070906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ee5eee4-3284-4508-9221-b310d3e497ff tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.217289 Aug 09 12:22:46.071550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 67/128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:45 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:46.074999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-30562a2f-d49c-430f-9186-6968bc486d9e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.222750 Aug 09 12:22:46.075580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 62/129] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:45 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:46.301745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:46.302743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:46.305989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:46.306972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:46.312521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:46.312918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:46.313834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:46.314051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:46.314492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:46.314895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:46.315047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:46.315368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:46.315791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:46.316489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:46.316904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:46.317410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:46.514422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:46.522049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:46.522217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80c352e6-abfd-4ee4-b1e0-3f63878db440 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.226987 Aug 09 12:22:46.522799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 68/130] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:46 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:46.531576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ac094c3d-5dd1-47bf-a46f-a373e5d1968a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.232521 Aug 09 12:22:46.536453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 63/131] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:46 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:47.092864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:47.093480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:47.095293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:47.095960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:47.100032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:47.100544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:47.100973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:47.101658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:47.102060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:47.102213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:47.102498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:47.102631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:47.102937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:47.103597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:47.104069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:47.104514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:47.295770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:47.299967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:47.303586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6eba64fd-bc60-4648-9ac4-58e093e2fa11 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.214761 Aug 09 12:22:47.304169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 69/132] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:47 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:47.307534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d667a9a1-917e-4ecc-ba7e-2595101e6bf7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.216342 Aug 09 12:22:47.308082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 64/133] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:47 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:47.547692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:47.548338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:47.552206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:47.552947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:47.554645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:47.555210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:47.555636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:47.556338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:47.556844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:47.557292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:47.559009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:47.559494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:47.559914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:47.560633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:47.561584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:47.561927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:47.759403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:47.764266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:47.769614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71419aa4-23ea-45c8-a073-d13cfd447905 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.227524 Aug 09 12:22:47.770171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 70/134] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:47 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:47.774214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1cd97905-6786-401b-a4c5-7d0c3a5dc484 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.225841 Aug 09 12:22:47.774853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 65/135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:47 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:48.324946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:48.325577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:48.329305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:48.329926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:48.332456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:48.332959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:48.333384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:48.335041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:48.335496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:48.335911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:48.336046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:48.336547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:48.336972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:48.337630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:48.338071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:48.338478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:48.555369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:48.563618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:48.571582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0271a5e8-13a3-471b-bda9-e73c22bc61fd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.246163 Aug 09 12:22:48.572294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 66/136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:48 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:48.579462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5381281-b42a-4610-ba17-d029c9c50b28 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.258285 Aug 09 12:22:48.581112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 71/137] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:48 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:48.792414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:48.793016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:48.797000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:48.797657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:48.800211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:48.800948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:48.801866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:48.803398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:48.803960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:48.804107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:48.804422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:48.804537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:48.804891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:48.805593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:48.806046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:48.806469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:49.028752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:49.040978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2f0748b2-d852-4b48-bfc5-b0a8857e92ec tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.251017 Aug 09 12:22:49.045238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 67/138] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:48 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:49.057877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:49.066366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a7cd8c7-9b05-4348-8262-2ab1786262d2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.274270 Aug 09 12:22:49.067094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 72/139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:48 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:49.593434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:49.594067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:49.600403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:49.600901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:49.601042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:49.601473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:49.601833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:49.601992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:49.602429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:49.602840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:49.608989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:49.609471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:49.609951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:49.610638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:49.611117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:49.611478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:50.050250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:50.058060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce016575-d22d-41d6-ae74-a407deb04718 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.468617 Aug 09 12:22:50.071700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 68/140] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:49 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:50.071700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:50.071700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:50.074646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:50.075139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:50.075564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:50.076259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:50.076745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:50.078689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:50.091781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:50.100358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa8ffeef-5bae-4e59-87f3-ab9536c801b0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.503272 Aug 09 12:22:50.109879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 73/141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:49 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:50.129924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:50.130769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:50.137369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:50.138375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:50.139326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:50.140986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:50.141593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:50.142163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:50.353263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:50.361590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71493dad-b832-4051-ac00-39f6d762484f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.297232 Aug 09 12:22:50.362669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 69/142] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:50 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:50.402359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:50.413920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f926e380-c60a-4a7c-86b7-95da9b9e92f0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.302731 Aug 09 12:22:50.414685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 74/143] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:50 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:51.079335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:51.079934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:51.086522 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:51.087065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:51.087644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:51.088525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:51.089075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:51.089581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:51.127677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:51.131413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:51.144821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:51.145710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:51.146602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:51.148032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:51.149301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:51.150348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:51.442603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:51.455567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5aee5280-c2d1-4467-8456-c7d75fe57cba tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.378965 Aug 09 12:22:51.471988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 70/144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:51 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:51.482647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:51.483695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:51.498349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:51.499650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:51.501506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:51.507978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:51.516590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:51.517302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:51.517748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:51.519074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e374be4e-61e9-44cd-80fe-6aeb10fa0bf9 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.397613 Aug 09 12:22:51.521092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 75/145] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:51 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:51.534994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:51.535489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:51.549432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:51.551664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:51.552755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:51.555571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:51.558369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:51.559737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:51.562274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:52.106419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:52.119959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9a2ca7bd-1ac8-40ef-8217-6f3e7c89b35b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.646166 Aug 09 12:22:52.121146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 71/146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:51 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:52.285456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-3ae0fc92-d3bc-4aba-aafe-29a1f8c95410 req-d28ef050-5103-4cea-a7b4-d30de6cf6610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211a1bb-283d-49db-bd1d-b2a7c0d5a691", "name": "network-vif-plugged", "status": "completed", "tag": "0a231768-1ff2-45d4-a810-69f36326fa79"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:52.295154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-3ae0fc92-d3bc-4aba-aafe-29a1f8c95410 req-d28ef050-5103-4cea-a7b4-d30de6cf6610 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:52.295705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-3ae0fc92-d3bc-4aba-aafe-29a1f8c95410 req-d28ef050-5103-4cea-a7b4-d30de6cf6610 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:52.296451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-3ae0fc92-d3bc-4aba-aafe-29a1f8c95410 req-d28ef050-5103-4cea-a7b4-d30de6cf6610 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:52.307798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-3ae0fc92-d3bc-4aba-aafe-29a1f8c95410 req-d28ef050-5103-4cea-a7b4-d30de6cf6610 service nova] Creating event network-vif-plugged:0a231768-1ff2-45d4-a810-69f36326fa79 for instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 on hv-cinder-85236 Aug 09 12:22:52.313058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-3ae0fc92-d3bc-4aba-aafe-29a1f8c95410 req-d28ef050-5103-4cea-a7b4-d30de6cf6610 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182498 Aug 09 12:22:52.313790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 72/147] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:52.365537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:52.404462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f1c68b57-a9b9-4f94-a00b-8af7b547212c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.876964 Aug 09 12:22:52.406797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 76/148] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:51 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:52.481404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:52.483508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:52.493393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:52.495743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:52.497205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:52.497932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:52.498838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:52.499740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:52.549998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:52.551061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:52.566502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:52.567834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:52.568495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:52.570304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:52.570950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:52.571554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:52.603708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:52.816620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:52.827416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1a975d2a-0790-49c7-acf8-c25d0d782e16 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.352806 Aug 09 12:22:52.828249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 73/149] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:52 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:52.859176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:52.867295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7f356f94-7385-41ad-9a4f-930fd5b026aa tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.323591 Aug 09 12:22:52.868028 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 77/150] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:52 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:53.142540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:53.143197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:53.158742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:53.163603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:53.164072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:53.164890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:53.165495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:53.166086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:53.428056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:53.429331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:53.439999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:53.441103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:53.443652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:53.453620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:53.454482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:53.454964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:53.455396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:53.459812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a7ae92ec-f5cc-4c9e-a037-62ef509ac2ea tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.315382 Aug 09 12:22:53.461973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 74/151] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:53 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:53.640320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:53.649620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eab4a04f-9f99-4002-8b3b-1873bd223a96 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.225614 Aug 09 12:22:53.656421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 78/152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:53 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:53.847458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:53.848555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:53.854560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:53.855268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:53.855694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:53.856603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:53.857200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:53.857913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:53.889864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:53.891251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:53.900650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:53.901402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:53.902055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:53.903869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:53.904566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:53.905856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:54.137529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:54.147849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-18ca8263-36d5-481c-859e-6c1d648ab713 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.304315 Aug 09 12:22:54.149349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 75/153] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:53 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:54.172957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:54.187238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d93a98fd-2dc0-4970-bbff-f65b27a45d54 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.298381 Aug 09 12:22:54.190737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 79/154] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:53 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:54.483134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:54.484023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:54.492937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:54.493978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:54.494873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:54.495930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:54.497238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:54.498446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:54.670489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:54.685583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:54.704558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:54.705358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:54.705805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:54.706604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:54.707062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:54.707479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:54.769027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:54.777779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1333e716-dbe6-443f-80cf-9c4c979f13c3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.298741 Aug 09 12:22:54.791671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 76/155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:54 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:54.983088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:54.991010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a64431a-d8b4-4daa-aa22-3a64357cf9a9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.325170 Aug 09 12:22:54.991886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 80/156] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:54 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:55.170186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:55.170870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:55.178505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:55.178984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:55.179402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:55.180082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:55.184146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:55.186094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:55.211894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:55.212854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:55.223443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:55.226721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:55.228670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:55.235058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:55.235520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:55.240432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:55.464737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:55.466890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:55.478344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c5c9ed5f-a48a-4bbc-afa5-a397e4b697b9 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.310479 Aug 09 12:22:55.478809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cffb8bb5-391c-4acf-86c0-17e460d3d13c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.267148 Aug 09 12:22:55.492414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 81/157] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:55 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:55.492414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-7b17aa3e-cf67-4c55-bfa5-11d837ad28f7 req-1deaf82b-f13c-47a9-9d23-b0df7effc32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f547825d-c0f5-40e7-8788-3a519b56ae51", "name": "network-vif-plugged", "status": "completed", "tag": "e12c36b3-adeb-4a4c-aa0d-1173e5045ba9"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:22:55.504899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 77/158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:55 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:55.508711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7b17aa3e-cf67-4c55-bfa5-11d837ad28f7 req-1deaf82b-f13c-47a9-9d23-b0df7effc32a service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:55.509400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7b17aa3e-cf67-4c55-bfa5-11d837ad28f7 req-1deaf82b-f13c-47a9-9d23-b0df7effc32a service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:55.510555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7b17aa3e-cf67-4c55-bfa5-11d837ad28f7 req-1deaf82b-f13c-47a9-9d23-b0df7effc32a service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:55.523024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-7b17aa3e-cf67-4c55-bfa5-11d837ad28f7 req-1deaf82b-f13c-47a9-9d23-b0df7effc32a service nova] Creating event network-vif-plugged:e12c36b3-adeb-4a4c-aa0d-1173e5045ba9 for instance f547825d-c0f5-40e7-8788-3a519b56ae51 on hv-cinder-85236 Aug 09 12:22:55.528614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-7b17aa3e-cf67-4c55-bfa5-11d837ad28f7 req-1deaf82b-f13c-47a9-9d23-b0df7effc32a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046248 Aug 09 12:22:55.529186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 82/159] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:22:55.799924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:55.800594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:55.808244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:55.808792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:55.809220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:55.809911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:55.810806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:55.812539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:56.005436 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:56.008421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ebba173d-7b73-4505-af69-867d9e94eed4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.212921 Aug 09 12:22:56.009170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 78/160] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:55 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:56.012800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:56.014031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:56.021523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:56.022016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:56.022448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:56.023147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:56.023603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:56.024028 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:56.184718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:56.195067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-32fbcef3-8505-4e8a-8d74-119c2003dcc2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.187624 Aug 09 12:22:56.195665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 83/161] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:56 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:56.501602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:56.502212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:56.504133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:56.505000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:56.510480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=92 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:56.511897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:56.512392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:56.512823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:56.513204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:56.513515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:56.513960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:56.514487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:56.514790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:56.515397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:56.517199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:56.518052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:56.518763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:56.747470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:56.758835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c395c4dd-549c-4217-b809-3a2038da7b91 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.259409 Aug 09 12:22:56.762409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 84/162] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:56 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:56.813107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:56.824427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-24104eda-0ca9-4358-8bb8-add0a18005a1 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.327189 Aug 09 12:22:56.824936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 79/163] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:56 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:57.034445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:57.035173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:57.042458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:57.043025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:57.043461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:57.044318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:57.044822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:57.045523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:57.189958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:57.197709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-da134a7a-0911-4aeb-a6ec-c6fa437a2d73 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.170863 Aug 09 12:22:57.208875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 85/164] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:57 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:57.216235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:57.217048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:57.225653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:57.228026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:57.229509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:57.232302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:57.233351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:57.234016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:57.377718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:57.386598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ac26e77a-ede4-4b17-99f8-6cf6b6396ae4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.174437 Aug 09 12:22:57.387261 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 80/165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:57 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:57.780030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:57.780665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:57.788675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:57.789610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:57.790518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:57.791256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:57.792226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:57.793112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:57.854462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:57.860068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:57.873439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:57.875103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:57.876700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:57.879483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:57.881145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:57.881798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:58.240526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:58.251155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0d9229f4-0448-4092-8382-e621a2878fb3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.475073 Aug 09 12:22:58.265133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 86/166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:57 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:58.271479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:58.272099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:58.278799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:58.279283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:58.279934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:58.280749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:58.281571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:58.282026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:58.286413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:58.294218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eab8b451-211d-41c6-820d-b9a5cdd488b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.450964 Aug 09 12:22:58.295142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 81/167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:57 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:58.407624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:58.408551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:58.414743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:58.415497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:58.416160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:58.417108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:58.417766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:58.418385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:58.422246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:58.431008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97447612-d683-49d0-9703-cd70c1f9a7f6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.164189 Aug 09 12:22:58.431784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 87/168] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:58 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:58.555805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:58.564121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-510548bc-ab64-4f10-ab6d-497ebd175374 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.160725 Aug 09 12:22:58.564741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 82/169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:58 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:22:59.271332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:59.272124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:59.278449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:59.279035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:59.279471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:59.280219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:59.280708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:59.281118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:59.315535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:59.318181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:59.325852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:59.326650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:59.327275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:59.328518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:59.329736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:59.330373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:59.474575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:59.494108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2926e681-f2c9-4866-bced-6074539a2210 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.226552 Aug 09 12:22:59.495266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 88/170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:59 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:59.499336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:59.499986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:59.513646 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:59.514209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:59.514840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:59.515562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:59.516007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:59.516464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:59.553225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:59.561616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-135ede2b-9abc-4568-9bab-352d2dcee830 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.250302 Aug 09 12:22:59.562573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 83/171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:59 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:59.586245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:22:59.588053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:22:59.595341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:59.596124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:59.596741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:59.597715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:22:59.598204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:22:59.598701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:22:59.685162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:59.693994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-447a9a07-a1c6-46be-9ef3-0d1aa7fa0676 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.198114 Aug 09 12:22:59.694925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 89/172] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:59 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:22:59.749491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:22:59.757863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6210fe92-1d2b-4ec4-b171-e6820210dd1a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.175646 Aug 09 12:22:59.758423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 84/173] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:22:59 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:00.518992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:00.519680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:00.538140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:00.539779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:00.540228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:00.540978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:00.544026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:00.544659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:00.587193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:00.587193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:00.597867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:00.597867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:00.597867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:00.597867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:00.598238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:00.598238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:01.013084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:01.022779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2138dd74-39d2-45bb-a947-851d77f1f493 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.510620 Aug 09 12:23:01.024337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 90/174] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:00 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:01.041387 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:01.042039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:01.050422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:01.050939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:01.051402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:01.052148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:01.052809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:01.053638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:01.057625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:01.067094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1b72091c-2fda-46ac-80d4-c04e617939ed tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.487864 Aug 09 12:23:01.068180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 85/175] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:00 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:01.073328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:01.073922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:01.081593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:01.083389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:01.083995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:01.085326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:01.085927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:01.086718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:01.344167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:01.353283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0c5c161-118d-48c1-9bd2-869db6bf3b3e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.327466 Aug 09 12:23:01.354228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 91/176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:01 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:01.372635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:01.383621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-62ac6579-278c-4f16-b306-681ca15e96e8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.313743 Aug 09 12:23:01.394780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 86/177] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:01 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:01.654291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-927c0f3a-05f3-405e-a612-c86744402c89 req-04e19c50-6998-4923-bc2b-55bb043e66cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a239bb-d81f-4ad7-b084-b2be4d75426d", "name": "network-vif-plugged", "status": "completed", "tag": "4907d57d-ce20-40f7-9bb0-68e03189ce29"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:23:01.674128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-927c0f3a-05f3-405e-a612-c86744402c89 req-04e19c50-6998-4923-bc2b-55bb043e66cf service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:01.676351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-927c0f3a-05f3-405e-a612-c86744402c89 req-04e19c50-6998-4923-bc2b-55bb043e66cf service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:01.678385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-927c0f3a-05f3-405e-a612-c86744402c89 req-04e19c50-6998-4923-bc2b-55bb043e66cf service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:01.706608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-927c0f3a-05f3-405e-a612-c86744402c89 req-04e19c50-6998-4923-bc2b-55bb043e66cf service nova] Creating event network-vif-plugged:4907d57d-ce20-40f7-9bb0-68e03189ce29 for instance 15a239bb-d81f-4ad7-b084-b2be4d75426d on hv-cinder-85236 Aug 09 12:23:01.721873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-927c0f3a-05f3-405e-a612-c86744402c89 req-04e19c50-6998-4923-bc2b-55bb043e66cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071172 Aug 09 12:23:01.722585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 92/178] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:23:02.047743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:02.048342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:02.055022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:02.055746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:02.056362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:02.057109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:02.057704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:02.058118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:02.092268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:02.093356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:02.101876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:02.102782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:02.103370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:02.104224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:02.104892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:02.105498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:02.270937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:02.284248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20254fa2-4af3-4af8-826f-157e8261a55d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.241145 Aug 09 12:23:02.300822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 87/179] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:02 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:02.373280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:02.382069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:02.383825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:02.387281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd5596fd-34ae-4184-9e9b-a2bb8cd4dbcc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.300103 Aug 09 12:23:02.390659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 93/180] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:02 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:02.411753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:02.413631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:02.415541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:02.416100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:02.416563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:02.417515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:02.418664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:02.419250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:02.429943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:02.430714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:02.431147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:02.433060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:02.433559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:02.433921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:02.744568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:02.748014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:02.754014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bd422069-5bb5-4a82-81de-454b76a7d138 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.383018 Aug 09 12:23:02.755314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 88/181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:02 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:23:02.766097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:02.789772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ba12a5c-2afb-4354-8dfd-c0bce8efb999 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.383694 Aug 09 12:23:02.790959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 94/182] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:02 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:03.316469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:03.317746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:03.329616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.330237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.330784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:03.331869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.332333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.332865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:03.413866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:03.415139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:03.424078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.425176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.425792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:03.426809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.428080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.429058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:03.481844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:03.620368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:03.633965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cb6dec11-b45d-4b99-af00-ba73d96a6538 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.318840 Aug 09 12:23:03.634860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 89/183] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:03 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:03.655957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:03.669388 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7cf7d28-832c-4d56-a87a-b946f6704648 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.261779 Aug 09 12:23:03.670086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 95/184] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:03 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:03.749745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-5f00141c-0321-475c-9c7e-3c8965422184 req-a0d28666-c01e-411a-9bd7-ada4faaae74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138f9e3b-bbbe-4ef3-9108-e66e8911f81c", "name": "network-vif-plugged", "status": "completed", "tag": "77debbd0-dda5-40b2-9a29-5390ecf3a5ec"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:23:03.767143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-5f00141c-0321-475c-9c7e-3c8965422184 req-a0d28666-c01e-411a-9bd7-ada4faaae74b service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.767608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-5f00141c-0321-475c-9c7e-3c8965422184 req-a0d28666-c01e-411a-9bd7-ada4faaae74b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.777540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:03.778439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:03.781316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=98 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:03.783880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-5f00141c-0321-475c-9c7e-3c8965422184 req-a0d28666-c01e-411a-9bd7-ada4faaae74b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:03.798022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.798589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.799025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:03.799733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.800177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.800612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:03.818019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-5f00141c-0321-475c-9c7e-3c8965422184 req-a0d28666-c01e-411a-9bd7-ada4faaae74b service nova] Creating event network-vif-plugged:77debbd0-dda5-40b2-9a29-5390ecf3a5ec for instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c on hv-cinder-85236 Aug 09 12:23:03.831615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-5f00141c-0321-475c-9c7e-3c8965422184 req-a0d28666-c01e-411a-9bd7-ada4faaae74b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085051 Aug 09 12:23:03.832558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 90/185] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:23:03.845622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:03.846335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:03.856437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.856861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.857257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:03.858035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:03.860817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:03.861258 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:04.102632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:04.113235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7f2e4149-efa3-4858-974c-5e9a8d691e13 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.338825 Aug 09 12:23:04.114019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:04.115285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 96/186] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:03 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:04.127893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c8b28d13-998d-4283-be05-a925d6b51b8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.294080 Aug 09 12:23:04.134202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 91/187] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:03 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:04.655330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:04.656241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:04.665282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:04.666214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:04.666829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:04.668456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:04.669618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:04.670301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:04.691896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:04.692655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:04.706117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:04.706617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:04.707296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:04.708224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:04.710604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:04.711332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:04.946219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:04.957191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-002fba28-afaf-451a-ae02-518f252fcd1c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1314 microversion: 2.1 time: 0.269971 Aug 09 12:23:04.957779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 92/188] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:04 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:23:04.971316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:04.979669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c28ea7c-abbf-4cd0-a085-3018ae41bbe8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1367 microversion: 2.1 time: 0.328699 Aug 09 12:23:04.980235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 97/189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:04 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:05.141290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:05.141910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:05.147959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:05.148717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:05.149382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:05.150418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:05.151039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:05.151718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:05.166356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:05.168050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:05.185407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:05.186475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:05.186835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:05.192418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:05.194218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:05.195967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:05.512721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:05.530199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:05.538529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d48bd195-7509-44ff-839e-876af3b9c151 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.406152 Aug 09 12:23:05.540787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9e04f52b-f296-429a-8c7f-e1fb0f664c45 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.383956 Aug 09 12:23:05.541537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 98/190] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:05 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:05.563786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 93/191] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:05 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:05.978150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:05.979605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:05.989664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:05.990154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:05.990619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:05.998547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:05.999744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:06.000244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:06.000735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:06.001382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:06.018010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:06.018496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:06.018923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:06.019766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:06.020301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:06.020708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:06.277159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:06.287259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9ec2340e-a08d-403e-88c2-241610cbf9b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1558 microversion: 2.1 time: 0.290762 Aug 09 12:23:06.290606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 94/192] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:05 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1558 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:06.313956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:06.317545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:06.331340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:06.338563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:06.339058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:06.339487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:06.340193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:06.346469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c718d05-52d8-4a1b-9ab1-4de034507a45 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1501 microversion: 2.1 time: 0.372500 Aug 09 12:23:06.348695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 99/193] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:05 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1501 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:06.353649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:06.354739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:06.583362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:06.583973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:06.597858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:06.598351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:06.598862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:06.599577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:06.600035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:06.600504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:07.051416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b91f1bb0-1ccb-4f30-a489-024c1b84461d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.741741 Aug 09 12:23:07.052066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 95/194] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 9 12:23:06 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-interface => generated 285 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:23:07.059111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:07.059111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:07.074548 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:07.075729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:07.076293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:07.078366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:07.079081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:07.081564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:07.323125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:07.330816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-907f4671-2c86-4d7b-931a-3860cf528fa9 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.752076 Aug 09 12:23:07.352813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 100/195] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:06 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:07.392359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:07.403920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60ca28d4-581e-4a81-b5b8-28e849222b7f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.350435 Aug 09 12:23:07.416774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 96/196] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:07 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:08.165897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-eb0b163f-4661-4041-8366-bc4e28d483b4 req-0b394670-681f-4306-9071-731596a9518d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56388ec4-a642-4d87-a2a1-da60a5c0f9f5", "name": "network-vif-plugged", "status": "completed", "tag": "cdeb0c4e-c7ea-4941-a99c-2b329d11b818"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:23:08.193423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-eb0b163f-4661-4041-8366-bc4e28d483b4 req-0b394670-681f-4306-9071-731596a9518d service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:08.193423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-eb0b163f-4661-4041-8366-bc4e28d483b4 req-0b394670-681f-4306-9071-731596a9518d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:08.193712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-eb0b163f-4661-4041-8366-bc4e28d483b4 req-0b394670-681f-4306-9071-731596a9518d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:08.220941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b097e8ff-b92d-4be5-ba3f-ffb38423c314"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:23:08.225214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:08.225370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-eb0b163f-4661-4041-8366-bc4e28d483b4 req-0b394670-681f-4306-9071-731596a9518d service nova] Creating event network-vif-plugged:cdeb0c4e-c7ea-4941-a99c-2b329d11b818 for instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 on hv-cinder-85236 Aug 09 12:23:08.233055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-eb0b163f-4661-4041-8366-bc4e28d483b4 req-0b394670-681f-4306-9071-731596a9518d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071472 Aug 09 12:23:08.235512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 101/197] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:23:08.240054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:08.241101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:08.241231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:08.242168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:08.242784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:08.243212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:08.375364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:08.377076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:08.387788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:08.388770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:08.389379 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:08.390263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:08.391090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:08.391660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:08.740909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:08.749801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-637bc708-e28a-4caa-9a0d-82af29fdd9a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.393399 Aug 09 12:23:08.750681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 102/198] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:08 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:23:08.761749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:08.763331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:08.772899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:08.773482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:08.774142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:08.775373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:08.776111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:08.776784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:08.977762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:08.988755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-99135faa-847f-4de8-a2f3-8572778995c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1322 microversion: 2.1 time: 0.236591 Aug 09 12:23:08.990147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 103/199] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:08 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:09.025397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-15ea14fd-0e79-414b-93e8-0ebeccc1c1b0 req-039649c1-60f8-4043-909b-5d7175a98d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f547825d-c0f5-40e7-8788-3a519b56ae51", "tag": "e12c36b3-adeb-4a4c-aa0d-1173e5045ba9"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:23:09.039911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-15ea14fd-0e79-414b-93e8-0ebeccc1c1b0 req-039649c1-60f8-4043-909b-5d7175a98d7b service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:09.040637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-15ea14fd-0e79-414b-93e8-0ebeccc1c1b0 req-039649c1-60f8-4043-909b-5d7175a98d7b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:09.041337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-15ea14fd-0e79-414b-93e8-0ebeccc1c1b0 req-039649c1-60f8-4043-909b-5d7175a98d7b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:09.055479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-15ea14fd-0e79-414b-93e8-0ebeccc1c1b0 req-039649c1-60f8-4043-909b-5d7175a98d7b service nova] Creating event network-changed:e12c36b3-adeb-4a4c-aa0d-1173e5045ba9 for instance f547825d-c0f5-40e7-8788-3a519b56ae51 on hv-cinder-85236 Aug 09 12:23:09.062100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-15ea14fd-0e79-414b-93e8-0ebeccc1c1b0 req-039649c1-60f8-4043-909b-5d7175a98d7b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040595 Aug 09 12:23:09.063145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 104/200] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:23:09.772348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:09.774260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:09.782259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:09.782746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:09.783221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:09.783912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:09.784961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:09.785545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:10.047113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:10.058700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-716d062e-d1a6-4ad4-832c-add190a1de33 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.290898 Aug 09 12:23:10.060132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 105/201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:09 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:10.067588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:10.068727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:10.078130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:10.079499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:10.080533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:10.082110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:10.083511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:10.084827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:10.321742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:10.332176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa9eeeec-fde5-4997-a755-77c726968f56 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1517 microversion: 2.1 time: 0.269978 Aug 09 12:23:10.332809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 106/202] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:10 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1517 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:10.363625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:23:10.365836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:10.376909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:10.377444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:10.377882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:10.378992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:10.379477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:10.379901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:10.449213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lazy-loading 'flavor' on Instance uuid 15a239bb-d81f-4ad7-b084-b2be4d75426d {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:23:10.624419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15cfff16-dbef-4832-8144-c51bf20e6843 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d/action" status: 200 len: 32 microversion: 2.1 time: 0.263996 Aug 09 12:23:10.625857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 107/203] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:23:10 2022] POST /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d/action => generated 32 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:23:10.638819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:10.639754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:10.649237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:10.649731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:10.650160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:10.650921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:10.651373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:10.651795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:10.850539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:10.859756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50e7928b-80ce-47f6-93ef-6184cfc768ee tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.227249 Aug 09 12:23:10.860349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 108/204] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:10 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:11.081767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:11.082279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:11.089146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:11.089659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:11.090093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:11.091029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:11.091825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:11.092494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:11.165602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3b05a25-185f-43bd-a093-7bc7c40451b8 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "POST /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.948446 Aug 09 12:23:11.167166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 97/205] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:23:08 2022] POST /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691/os-volume_attachments => generated 194 bytes in 2951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:23:11.267513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:11.278135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ae5bda9b-2dfd-4370-8478-3028ace7f839 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.202409 Aug 09 12:23:11.279459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 109/206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:11 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:11.883267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:11.884281 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:11.895033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:11.895663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:11.896094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:11.896816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:11.897258 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:11.897673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:12.037497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:12.049002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-95bb1f6c-dd9d-4163-941c-9c2aa652b758 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.171550 Aug 09 12:23:12.049763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 98/207] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:11 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:12.300508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:12.301092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:12.307182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:12.307674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:12.308086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:12.308824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:12.309276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:12.309696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:12.452031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:12.462572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-489220ae-f623-4582-b63a-922f715f7310 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.167072 Aug 09 12:23:12.472415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 110/208] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:12 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:13.071130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:13.071693 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:13.078975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:13.079454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:13.079892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:13.080619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:13.081052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:13.081468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:13.227901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:13.235650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6d80dcef-991d-4145-8850-8d69d0d3031b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.168464 Aug 09 12:23:13.236256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 99/209] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:13 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:13.485029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:13.485614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:13.491658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:13.492133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:13.492588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:13.493271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:13.493712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:13.494223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:13.514340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:13.631097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:13.638730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a03e96f-e01e-4b4c-928b-b549d6b23879 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.157490 Aug 09 12:23:13.639289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 111/210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:13 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:14.260302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:14.261510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:14.272323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:14.273067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:14.273716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:14.274773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:14.275449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:14.276059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:14.424113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:14.432195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8337afe9-940f-40e1-a874-22410b8b14b2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.177415 Aug 09 12:23:14.444536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 100/211] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:14 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:14.662279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:14.662986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:14.672367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:14.672873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:14.673304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:14.673999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:14.674444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:14.674854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:14.821126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:14.829087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c3d0b75-8d03-46fd-ba12-564d72a54bbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.172253 Aug 09 12:23:14.829631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 112/212] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:14 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:15.452355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:15.452994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:15.460593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:15.461219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:15.461921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:15.462946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:15.463231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:15.463650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:15.601459 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:15.609389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6b8d337f-50b5-4c4d-918b-e9d84e67f6fe tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.160804 Aug 09 12:23:15.609977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 101/213] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:15 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:15.850097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:15.850755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:15.858049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:15.858999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:15.859589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:15.860313 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:15.860800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:15.861223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:16.002277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:16.010980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8955bbf1-90cf-4543-acff-1f0a20786e88 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.164546 Aug 09 12:23:16.011570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 113/214] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:15 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:16.631071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:16.631672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:16.638222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:16.638701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:16.639164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:16.639802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:16.640540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:16.642419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:16.782701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:16.790343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a66f8c6-0867-4d79-80ac-9a1895f6499b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.163561 Aug 09 12:23:16.790909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 102/215] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:16 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:17.033573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:17.034185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:17.040915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:17.041416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:17.041829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:17.042579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:17.043029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:17.043452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:17.191041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:17.200670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c529070-c5b8-4eb5-a2f7-4d8b2488893d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.171472 Aug 09 12:23:17.201270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 114/216] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:17 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:17.811199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:17.811837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:17.818642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:17.819011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:17.819510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:17.820210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:17.820714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:17.821111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:17.959530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:17.970333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b28bc54b-5d11-40ee-9ffe-6f2cbad8474a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.163108 Aug 09 12:23:17.970903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 103/217] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:17 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:18.222180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:18.222779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:18.229352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:18.229834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:18.230258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:18.230978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:18.231398 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:18.231815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:18.373633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:18.382383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7bbe2121-3bf4-49e3-b28e-b6090e78cfbf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.164609 Aug 09 12:23:18.382925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 115/218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:18 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:18.991778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:18.992417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:18.999390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:18.999891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:19.000332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:19.001104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:19.001551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:19.001971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:19.139884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:19.147609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f414168a-156b-4eda-8695-a6d0ab208909 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.159865 Aug 09 12:23:19.148177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 104/219] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:18 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:19.411959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:19.412588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:19.419163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:19.419650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:19.420074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:19.420801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:19.421262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:19.421675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:19.552542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:19.560336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f3c41915-71f5-463a-b1e1-6632f3c1e643 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.152300 Aug 09 12:23:19.560945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 116/220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:19 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:20.170494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:20.171102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:20.177992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:20.178469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:20.178888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:20.179566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:20.180005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:20.180423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:20.184437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:20.324198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:20.332867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c9bc86d5-39e5-4773-943a-4e83c3183b04 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.166292 Aug 09 12:23:20.333739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 105/221] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:20 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:20.586934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:20.588081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:20.598426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:20.598888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:20.599309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:20.600001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:20.600538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:20.601058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:20.740937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:20.752201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62d95ee1-dcf2-40bb-99de-07748a0dae24 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.172872 Aug 09 12:23:20.753105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 117/222] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:20 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:21.357266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:21.357871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:21.367782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:21.368474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:21.369079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:21.370054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:21.370667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:21.371254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:21.524031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:21.531856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-affc2c46-1c29-4432-9782-e8e057d83060 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.180968 Aug 09 12:23:21.532408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 106/223] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:21 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:21.774364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:21.775745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:21.783093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:21.783798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:21.784656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:21.785730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:21.786401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:21.787155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:21.951994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:21.959612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c9584d0-14dc-4af3-972c-43f3dde41764 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.189338 Aug 09 12:23:21.960291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 118/224] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:21 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:22.552763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:22.553910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:22.560092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:22.560614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:22.561106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:22.561732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:22.562167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:22.562610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:22.699776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:22.707936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-16a80fa8-8b45-413b-992a-50f3c4afb3df tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.158920 Aug 09 12:23:22.708545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 107/225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:22 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:22.982468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:22.984008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:22.994438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:22.996540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:22.997252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:22.999861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:23.000737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:23.001137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:23.276859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:23.284876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-018a96a7-cc42-4920-a28d-0156a4a8e48f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1362 microversion: 2.1 time: 0.307058 Aug 09 12:23:23.285444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 119/226] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:22 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:23.729824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:23.730754 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:23.737415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:23.737943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:23.738435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:23.739287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:23.739732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:23.740308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:23.902785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:23.911361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dda40049-72ca-426d-81aa-927a9b67cab3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.186035 Aug 09 12:23:23.911932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 108/227] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:23 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:24.306498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:24.307062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:24.313847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:24.314329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:24.315063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:24.315825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:24.316282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:24.316814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:24.538753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:24.546802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4633cd07-7524-439f-be64-f3c8e9216a81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1547 microversion: 2.1 time: 0.244527 Aug 09 12:23:24.547320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 120/228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:24 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1547 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:24.568489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:24.569042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:24.575168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:24.575645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:24.576062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:24.576765 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:24.577208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:24.577616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:24.665566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1f47678b-6d3e-4829-bb5b-25b461e06735 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101482 Aug 09 12:23:24.666164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 109/229] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 9 12:23:24 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:23:24.932505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:24.933112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:24.939853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:24.940710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:24.941197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:24.942079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:24.942701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:24.943326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:25.291066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:25.298930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-549d479b-bf63-4337-9b11-7a388dcaa6d7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.370850 Aug 09 12:23:25.299637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 121/230] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:24 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:23:26.320038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:26.320669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:26.345698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:26.346468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:26.348343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:26.352634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:26.353504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:26.358579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:26.370461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-b806f935-14ad-449d-b80d-0bce44900cea req-1473a3c5-5362-4788-9e85-5f7d1af3226f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56388ec4-a642-4d87-a2a1-da60a5c0f9f5", "tag": "cdeb0c4e-c7ea-4941-a99c-2b329d11b818"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:23:26.391185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b806f935-14ad-449d-b80d-0bce44900cea req-1473a3c5-5362-4788-9e85-5f7d1af3226f service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:26.396133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b806f935-14ad-449d-b80d-0bce44900cea req-1473a3c5-5362-4788-9e85-5f7d1af3226f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:26.397040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b806f935-14ad-449d-b80d-0bce44900cea req-1473a3c5-5362-4788-9e85-5f7d1af3226f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:26.429659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-b806f935-14ad-449d-b80d-0bce44900cea req-1473a3c5-5362-4788-9e85-5f7d1af3226f service nova] Creating event network-changed:cdeb0c4e-c7ea-4941-a99c-2b329d11b818 for instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 on hv-cinder-85236 Aug 09 12:23:26.438240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-b806f935-14ad-449d-b80d-0bce44900cea req-1473a3c5-5362-4788-9e85-5f7d1af3226f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072038 Aug 09 12:23:26.438910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 122/231] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:23:26.630545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:26.646815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9bfd5dc1-cb9a-4280-9286-1250018c12d4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.330963 Aug 09 12:23:26.648336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 110/232] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:26 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:27.668591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:27.669231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:27.675564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:27.676027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:27.676486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:27.677244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:27.678066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:27.678562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:27.823891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:27.831360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e7cdae59-875a-42a5-b7ae-0b85c353b60a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.167430 Aug 09 12:23:27.831936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 123/233] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:27 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:28.853308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:28.854752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:28.857507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=64 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:28.863342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:28.863819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:28.864248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:28.864972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:28.865454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:28.868555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:29.025971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:29.033811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4894abb9-6cf1-4d03-845a-af4b7b450aa5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.185794 Aug 09 12:23:29.034543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 111/234] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:28 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:30.055566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:30.056172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:30.062424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:30.063118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:30.063541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:30.064245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:30.064727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:30.065146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:30.199755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:30.207681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a49c84c-df33-4b8a-a380-eba55c0943d6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.156240 Aug 09 12:23:30.208253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 124/235] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:30 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:31.230009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:31.230713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:31.237465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:31.237945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:31.238368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:31.239044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:31.239487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:31.239899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:31.375825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:31.387671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4387679c-eb47-472d-a330-be91447ee886 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.161853 Aug 09 12:23:31.388620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 112/236] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:31 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:32.413677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:32.414974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:32.424739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:32.425521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:32.426226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:32.427342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:32.428078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:32.429417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:32.562682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:32.570446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-66a97491-ce02-485d-b927-63f5c479e099 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.163284 Aug 09 12:23:32.571608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 125/237] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:32 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:33.591456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:33.592055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:33.598877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:33.599472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:33.599905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:33.600605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:33.601045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:33.601465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:33.735276 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:33.743042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b5334d90-ed72-4c89-9672-d80804e1d001 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.155507 Aug 09 12:23:33.743600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 113/238] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:33 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:34.763848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:34.764472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:34.767499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=60 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:34.771120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:34.771585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:34.772020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:34.772773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:34.773221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:34.775681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:34.909475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:34.918465 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1b65adcf-8e63-433c-86cf-260a245eee0d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.158568 Aug 09 12:23:34.919018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 126/239] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:34 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:35.938919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:35.939517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:35.945944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:35.946968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:35.947589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:35.948283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:35.948759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:35.949175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:36.096086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:36.103990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4162577-d91a-4a1b-a46a-510a5b424402 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.168857 Aug 09 12:23:36.104596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 114/240] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:35 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:37.132795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:37.133391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:37.140850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:37.141330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:37.141756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:37.142439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:37.142882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:37.143306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:37.285698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:37.296141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4fbe6869-71f3-4426-b306-fc4c76193329 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.167583 Aug 09 12:23:37.296817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 127/241] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:37 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:38.321572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:38.322488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:38.333492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:38.334300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:38.335027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:38.336167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:38.336964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:38.337673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:38.479838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:38.488008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-afe5a2ea-68af-4068-a864-2827254968d5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.172971 Aug 09 12:23:38.488597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 115/242] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:38 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:39.513487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:39.514485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:39.524648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:39.525435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:39.526148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:39.527428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:39.527883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:39.528339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:39.661608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:39.665084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:39.669928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-10ef6e31-7a61-42b2-ae77-2f94068347b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.163040 Aug 09 12:23:39.670496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 128/243] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:39 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:40.691197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:40.691861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:40.699714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:40.700206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:40.700793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:40.701465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:40.701908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:40.702319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:40.832462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:40.844130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2069a9a3-840b-491f-a352-e9d812fde628 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.156626 Aug 09 12:23:40.845043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 116/244] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:40 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:41.865662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:41.866260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:41.873413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:41.873887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:41.874316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:41.874997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:41.875451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:41.875865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:42.014614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:42.024508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa0f8666-e31d-4611-8ee8-bb529cc58453 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.162759 Aug 09 12:23:42.025263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 129/245] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:41 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:43.048229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:43.048835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:43.055719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:43.056228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:43.056701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:43.057427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:43.057875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:43.058289 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:43.195964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:43.208036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-27a4f07f-8ee4-47a7-943b-da19941b529a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.164473 Aug 09 12:23:43.209002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 117/246] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:43 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:43.441439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:43.441963 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:43.448610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:43.449099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:43.449503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:43.450204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:43.450656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:43.451072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:43.476490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:23:43.564028 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-18193525-9318-440b-b9f2-9704222a108c tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 204 len: 0 microversion: 2.1 time: 0.126262 Aug 09 12:23:43.565063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 130/247] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:23:43 2022] DELETE /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:23:43.574304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:43.575080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:43.581880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:43.582366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:43.582796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:43.583556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:43.584010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:43.584458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:43.727745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:43.736629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cf4c0042-c712-4510-a99d-9b08161afa23 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.166899 Aug 09 12:23:43.737198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 118/248] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:43 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:44.231870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:44.232769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:44.244864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:44.245386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:44.245856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:44.246540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:44.247316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:44.247738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:44.389149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:44.396913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-54fa43db-ece5-4e1c-9630-5860e6053eeb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.169391 Aug 09 12:23:44.397485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 131/249] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:44 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:44.758577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:44.760252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:44.768592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:44.769076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:44.770369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:44.771156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:44.771484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:44.771907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:44.914374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:44.923301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1be48606-96cf-4a3e-a0f7-0c8aa998062d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.168700 Aug 09 12:23:44.923884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 119/250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:44 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:45.418340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:45.418948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:45.425876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:45.426381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:45.426810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:45.427506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:45.427954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:45.428365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:45.574772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:45.582623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16ba6dc0-5bc3-418f-8f10-693a4cb41c2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.168301 Aug 09 12:23:45.583183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 132/251] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:45 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:45.944956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:45.945587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:45.952526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:45.953074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:45.953548 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:45.954310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:45.954876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:45.955273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:46.102135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:46.112944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0ed8cb9c-8c0a-457e-a4dd-db0be87fedbc tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.171930 Aug 09 12:23:46.113500 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 120/252] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:45 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:46.606645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:46.607477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:46.615547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:46.616022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:46.616489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:46.617161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:46.617615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:46.618017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:46.755305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:46.763010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aeed61f4-4635-4de3-a9a8-06af8c72f367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.162878 Aug 09 12:23:46.763951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 133/253] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:46 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:47.138878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:47.139906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:47.150799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:47.151496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:47.152210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:47.153401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:47.154146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:47.154844 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:47.291663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:47.300152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-362fc557-9f44-4b8e-9fda-295a73b6bbba tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.167784 Aug 09 12:23:47.300767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 121/254] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:47 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:47.788225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:47.788913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:47.798204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:47.798921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:47.799565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:47.800616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:47.801188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:47.801798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:47.943562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:47.956624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9dbb86ba-4a26-4347-bbb5-ef5c5270a673 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.174755 Aug 09 12:23:47.957382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 134/255] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:47 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:48.321777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:48.322336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:48.329156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:48.329628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:48.330041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:48.330740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:48.331182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:48.331715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:48.335550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:48.476133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:48.484516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-31684417-2399-4261-901d-065d84f18c5e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.167158 Aug 09 12:23:48.485106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 122/256] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:48 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:48.981962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:48.982936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:48.991333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:48.991810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:48.992230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:48.992947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:48.993390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:48.993800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:49.135037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:49.144848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b0ce3b4-0503-408c-a059-b966514432e2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.168934 Aug 09 12:23:49.145552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 135/257] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:48 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:49.506425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:49.506974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:49.513843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:49.514317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:49.514744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:49.515429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:49.515872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:49.516320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:49.657716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:49.665971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6a90f160-140a-48f1-b737-c2596563d21f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.163747 Aug 09 12:23:49.666515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 123/258] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:49 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:50.170252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:50.170863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:50.177620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:50.178126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:50.178527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:50.179196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:50.179639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:50.180050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:50.325810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:50.338049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ec46b61-ce9d-423c-8847-61d50b497b9a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.171607 Aug 09 12:23:50.338626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 136/259] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:50 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:50.688129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:50.690025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:50.700731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:50.701461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:50.702415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:50.703471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:50.704289 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:50.705034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:50.870605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:50.883822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eec89cab-c0e4-4c05-b47c-c4b742dd8452 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.199308 Aug 09 12:23:50.884896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 124/260] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:50 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:51.369791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:51.370846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:51.379572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:51.380052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:51.380496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:51.381349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:51.381958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:51.382593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:51.522013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:51.529666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-467b078e-257f-4146-adaa-845e27bd9ed3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.166037 Aug 09 12:23:51.530226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 137/261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:51 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:51.912218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:51.912870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:51.919989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:51.920505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:51.920935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:51.921618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:51.922103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:51.922543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:52.051116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:52.061377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e8fed757-f382-48ba-909f-9cd2acea073b tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.152954 Aug 09 12:23:52.062351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 125/262] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:51 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:52.551188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:52.551759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:52.558084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:52.558577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:52.558986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:52.559662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:52.560156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:52.560592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:52.699914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:52.708641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0118758-3ae5-45d1-b209-fe2987155035 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.161798 Aug 09 12:23:52.709280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 138/263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:52 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:53.087784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:53.088680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:53.097922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:53.098401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:53.098823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:53.099517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:53.099963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:53.100398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:53.234790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:53.242901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8437e413-5e83-4fc1-9884-07ecb63360af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1553 microversion: 2.1 time: 0.161685 Aug 09 12:23:53.243474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 126/264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:53 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:53.730744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:53.731336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:53.737887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:53.738359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:53.738809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:53.740307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:53.740780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:53.741193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:53.882691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-63fdc46a-2da5-4b50-a070-a3345e8b16bc req-91485bc8-1daf-412a-a158-22fa1b984a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211a1bb-283d-49db-bd1d-b2a7c0d5a691", "name": "network-vif-deleted", "tag": "0a231768-1ff2-45d4-a810-69f36326fa79"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:23:53.898967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-63fdc46a-2da5-4b50-a070-a3345e8b16bc req-91485bc8-1daf-412a-a158-22fa1b984a30 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:53.899561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-63fdc46a-2da5-4b50-a070-a3345e8b16bc req-91485bc8-1daf-412a-a158-22fa1b984a30 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:53.900028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-63fdc46a-2da5-4b50-a070-a3345e8b16bc req-91485bc8-1daf-412a-a158-22fa1b984a30 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:53.913154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-63fdc46a-2da5-4b50-a070-a3345e8b16bc req-91485bc8-1daf-412a-a158-22fa1b984a30 service nova] Creating event network-vif-deleted:0a231768-1ff2-45d4-a810-69f36326fa79 for instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 on hv-cinder-85236 Aug 09 12:23:53.918688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-63fdc46a-2da5-4b50-a070-a3345e8b16bc req-91485bc8-1daf-412a-a158-22fa1b984a30 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039673 Aug 09 12:23:53.919471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 127/265] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:23:53.960952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:53.968693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc74d79f-3e1b-4474-9bfe-a812bd1d8eaf tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.242460 Aug 09 12:23:53.969540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 139/266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:53 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:54.267473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:54.268164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:54.274808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:54.275284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:54.275711 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:54.276415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:54.276892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:54.277308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:54.345474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:54.354128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-abbb78d2-0580-472e-baae-e8b24dfa95bb tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1511 microversion: 2.1 time: 0.093013 Aug 09 12:23:54.354761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 128/267] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:54 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1511 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:54.991812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:54.992752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:55.000637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:55.001705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:55.002504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:55.003885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:55.004238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:55.004762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:55.138447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:55.146507 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34184917-eea7-4991-8234-b70ec4620a00 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.160093 Aug 09 12:23:55.147070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 140/268] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:54 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:55.391086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:55.392501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:55.404107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:55.404999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:55.405703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:55.406932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:55.407365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:55.407799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:55.472999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:55.481389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ff475f2-81d8-4626-bfce-efb1790d1985 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1511 microversion: 2.1 time: 0.096764 Aug 09 12:23:55.481987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 129/269] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:55 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:56.175000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:56.175587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:56.182110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:56.182597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:56.183021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:56.183705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:56.184153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:56.184619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:56.320142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:56.327892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16e7f970-e5fd-4330-90ab-d3bccb42576f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.159093 Aug 09 12:23:56.328483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 141/270] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:56 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:56.507493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:56.508450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:56.518827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:56.519300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:56.519726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:56.520405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:56.520889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:56.521299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:56.587203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:56.595618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-25b6ad0f-bc22-4112-ba23-69536111e5ab tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1511 microversion: 2.1 time: 0.095079 Aug 09 12:23:56.596332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 130/271] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:56 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:57.359363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:57.360291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:57.368007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:57.368512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:57.369226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:57.369899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:57.370339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:57.370715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:57.504582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:57.516040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9aa93f04-fd97-4939-9ad1-94db0b50b7a5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.162789 Aug 09 12:23:57.516968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 142/272] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:57 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:57.621195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:57.622159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:57.632881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:57.633666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:57.634369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:57.635656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:57.636433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:57.637123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:57.707616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:57.716046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-35a382eb-525d-4854-9389-eeeed2c78ff6 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1511 microversion: 2.1 time: 0.101310 Aug 09 12:23:57.716647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 131/273] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:57 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:23:58.541484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:58.542165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:58.550007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:58.550680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:58.551238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:58.553174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:58.553767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:58.554291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:58.695964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:58.700194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:58.705324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c02c558-9cbb-44bb-8541-49d61ea57f10 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.169816 Aug 09 12:23:58.705891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 143/274] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:58 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:58.738836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:58.740280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:58.749439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:58.749922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:58.750350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:58.751039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:58.751488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:58.751904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:58.821166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:58.829419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-79fa3e13-3340-4044-abf8-f13de36f101e tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1511 microversion: 2.1 time: 0.094376 Aug 09 12:23:58.829924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 132/275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:58 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:59.731586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:59.732597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:59.742831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:59.743316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:59.743741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:59.744813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:59.744933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:59.745282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:59.859397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:23:59.859964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:23:59.862437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=44 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:59.868181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:59.868677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:59.869104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:59.869785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:23:59.870228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:23:59.870638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:23:59.874774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:59.883218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a754dd2-060a-49a3-a2d3-8c8b82e340fc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.159233 Aug 09 12:23:59.884109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 144/276] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:59 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:23:59.936576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:23:59.944538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-912e7ffb-f3e4-45b4-aa90-efbdff7f4310 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1511 microversion: 2.1 time: 0.089166 Aug 09 12:23:59.945088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 133/277] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:23:59 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:00.907334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:00.907936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:00.915431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:00.915878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:00.916331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:00.917040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:00.917487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:00.917898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:00.966100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:00.966704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:00.973316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:00.974202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:00.974646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:00.975336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:00.975851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:00.976194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:01.050408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:01.059043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0a0d1aba-a880-4130-a8aa-15e907218d7d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1511 microversion: 2.1 time: 0.096846 Aug 09 12:24:01.059629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 134/278] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:00 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:24:01.077653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:01.086066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c489ac5-edc2-42d4-82e3-8176744171a2 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.184913 Aug 09 12:24:01.086886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 145/279] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:00 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:02.084588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:02.085286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:02.092932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:02.093422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:02.093862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:02.094596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:02.095085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:02.095554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:02.106897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:02.107491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:02.113471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:02.113942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:02.114463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:02.115170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:02.115615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:02.116310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:02.161342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:02.169640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-55b41f92-fe56-4c9c-8934-013cacd4be32 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1345 microversion: 2.1 time: 0.091238 Aug 09 12:24:02.170310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 135/280] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:02 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:02.258160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:02.265676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3a35145b-5682-4934-91e9-0d480bc0226c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.162713 Aug 09 12:24:02.266232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 146/281] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:02 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:24:03.194618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:03.195257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:03.203862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:03.204618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:03.205011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:03.205842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:03.206402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:03.206918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:03.275485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:03.283343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aaf8e75b-7ad8-4082-9162-7224c47650c2 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1345 microversion: 2.1 time: 0.095179 Aug 09 12:24:03.283919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 136/282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:03 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:03.286613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:03.287312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:03.293413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:03.293896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:03.294326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:03.295011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:03.295465 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:03.295870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:03.428059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:03.435753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c173f6a-6c56-4350-943e-4eecfd394e61 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.153428 Aug 09 12:24:03.436311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 147/283] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:03 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:04.304483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:04.305209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:04.311918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:04.312416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:04.312885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:04.313620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:04.314061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:04.314501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:04.380117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:04.388973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c980fbe9-4a9f-4c94-aba9-d112fdf4b7d0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1345 microversion: 2.1 time: 0.088553 Aug 09 12:24:04.389536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 137/284] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:04 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:04.456998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:04.457588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:04.464124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:04.464642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:04.465057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:04.465733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:04.466178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:04.466592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:04.598272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:04.606566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c2194d17-16f8-4d25-ba73-be1ca0e39297 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.153471 Aug 09 12:24:04.607112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 148/285] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:04 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:05.409918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:05.410548 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:05.417190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:05.417673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:05.418100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:05.418786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:05.419239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:05.419651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:05.450405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:05.450881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:05.451313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:05.451767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lazy-loading 'fault' on Instance uuid d211a1bb-283d-49db-bd1d-b2a7c0d5a691 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:24:05.505848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf95a8321a249c48d1e7f0b39a067d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f51668a0b04e4f9e51d6356b854c7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:05.515562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a47d7901-1ee8-4d98-b9c8-471efe6b67f0 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 200 len: 1350 microversion: 2.1 time: 0.109480 Aug 09 12:24:05.516141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 138/286] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:05 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:05.627327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:05.628308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:05.630289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:05.635926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:05.636410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:05.636860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:05.637547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:05.637996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:05.638411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:05.795039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:05.803575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74a907d8-d58a-4025-89ae-5d840d1f07cd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.179973 Aug 09 12:24:05.804453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 149/287] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:05 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:06.537372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:06.538579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:06.546492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:06.547055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:06.547727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:06.548744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:06.549331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:06.549826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:06.556678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:06.567933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] HTTP exception thrown: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Request method failure captured: Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 HTTP/1.1 Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFyl5_uQ3p2jDudF40ozrMmhTvIGNEfwwB_fXWltDN16gs8DbeWclGLEX6THEgdA4gXkcA3OXijD-cID44bxZC2gqi6-N0wZAgOf2m9N3AEHOtkFyduabvDup6D7A0IGDjCb84P2A-Nn8Wdgv4icvhCalVEyz3FF5qMjwgsBhoQS0M Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 25f51668a0b04e4f9e51d6356b854c7b Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:24:06.572701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 25f51668a0b04e4f9e51d6356b854c7b Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-DeleteServersTestJSON-736353905-project Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: ebf95a8321a249c48d1e7f0b39a067d3 Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-DeleteServersTestJSON-736353905-project Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.574194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': 'd211a1bb-283d-49db-bd1d-b2a7c0d5a691'} Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:24:06.575324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.576718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.577940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Returning 404 to user: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:24:06.584029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-44a1354a-7db2-4bd3-ba81-877e67d04878 tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 404 len: 111 microversion: 2.1 time: 0.040764 Aug 09 12:24:06.585728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 139/288] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:06 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:24:06.703305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:06.705486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:06.711364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:06.711844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:06.712279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:06.713004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:06.713456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:06.713877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:06.727598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] HTTP exception thrown: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Request method failure captured: Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691/os-volume_attachments HTTP/1.1 Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFyl5_uQ3p2jDudF40ozrMmhTvIGNEfwwB_fXWltDN16gs8DbeWclGLEX6THEgdA4gXkcA3OXijD-cID44bxZC2gqi6-N0wZAgOf2m9N3AEHOtkFyduabvDup6D7A0IGDjCb84P2A-Nn8Wdgv4icvhCalVEyz3FF5qMjwgsBhoQS0M Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 25f51668a0b04e4f9e51d6356b854c7b Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:24:06.732703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 25f51668a0b04e4f9e51d6356b854c7b Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-DeleteServersTestJSON-736353905-project Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: ebf95a8321a249c48d1e7f0b39a067d3 Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-DeleteServersTestJSON-736353905-project Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.734161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'server_id': 'd211a1bb-283d-49db-bd1d-b2a7c0d5a691'} Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:24:06.735068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:06.736615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:06.739213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Returning 404 to user: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:24:06.739213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-069608dc-0d5e-4222-8c06-2977072dc0af tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035480 Aug 09 12:24:06.739213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 150/289] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:24:06 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:24:06.831223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:06.831223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:06.833116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:06.833599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:06.834021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:06.834752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:06.835408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:06.835826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:06.969108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:06.981393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-622af23e-6b6b-4c7a-b6bc-86a390184965 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.158920 Aug 09 12:24:06.982117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 140/290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:06 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:08.006734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:08.007348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:08.013779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:08.014249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:08.014668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:08.015340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:08.015782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:08.016189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:08.153037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:08.160781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c96c1a9-129a-4aea-a999-7dfad1fcd9ed tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.158464 Aug 09 12:24:08.161336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 151/291] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:08 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:09.187165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:09.188047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:09.198226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:09.198987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:09.199727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:09.200917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:09.201624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:09.202294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:09.340450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:09.351833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-748403d4-cb05-47d6-8d31-eab4e19917f6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.171198 Aug 09 12:24:09.352602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 141/292] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:09 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:10.381971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:10.382758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:10.389928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:10.390466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:10.390946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:10.391713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:10.392223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:10.392731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:10.542583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:10.555034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1edb87bc-577d-4369-a3ba-7d37546353dd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.179585 Aug 09 12:24:10.555812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 152/293] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:10 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:11.579419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:11.580332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:11.589812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:11.590292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:11.590720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:11.591409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:11.592154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:11.592599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:11.725216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:11.733292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-daa45492-7868-43ed-837f-b8e72bd01d82 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.159880 Aug 09 12:24:11.733883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 142/294] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:11 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:12.755172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:12.755777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:12.762152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:12.762542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:12.762973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:12.763662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:12.764117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:12.764557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:12.907116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:12.915315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5c505f8-401a-45f5-a3d3-051f67d26acc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.164453 Aug 09 12:24:12.915848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 153/295] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:12 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:13.940422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:13.941405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:13.952312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:13.953201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:13.953919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:13.955043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:13.955777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:13.956455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:14.093599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:14.101231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6628787-442b-4923-95a3-6230e6d53a20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.167726 Aug 09 12:24:14.101840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 143/296] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:13 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:15.122563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:15.123043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:15.129637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:15.130174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:15.130532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:15.131230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:15.131651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:15.132139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:15.262720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:15.270417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-11fa064c-540b-4b2d-85f6-2084249ce88d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.152008 Aug 09 12:24:15.270973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 154/297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:15 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:15.400571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:15.401104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:15.407942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:15.408473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:15.408897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:15.409578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:15.410048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:15.410454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:15.424360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] HTTP exception thrown: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Request method failure captured: Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 HTTP/1.1 Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFyl5_uQ3p2jDudF40ozrMmhTvIGNEfwwB_fXWltDN16gs8DbeWclGLEX6THEgdA4gXkcA3OXijD-cID44bxZC2gqi6-N0wZAgOf2m9N3AEHOtkFyduabvDup6D7A0IGDjCb84P2A-Nn8Wdgv4icvhCalVEyz3FF5qMjwgsBhoQS0M Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 25f51668a0b04e4f9e51d6356b854c7b Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:24:15.425951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 25f51668a0b04e4f9e51d6356b854c7b Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-DeleteServersTestJSON-736353905-project Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: ebf95a8321a249c48d1e7f0b39a067d3 Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-DeleteServersTestJSON-736353905-project Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.427403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': 'd211a1bb-283d-49db-bd1d-b2a7c0d5a691'} Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:24:15.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.429898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.431452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Returning 404 to user: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:24:15.431452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-38db38b9-7506-4ffe-8172-557a2102338d tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 404 len: 111 microversion: 2.1 time: 0.030758 Aug 09 12:24:15.431452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 144/298] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:24:15 2022] DELETE /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:24:15.438453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:15.439075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] [instance: d211a1bb-283d-49db-bd1d-b2a7c0d5a691] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:15.445890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:15.446368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:15.446795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:15.447474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:15.447917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:15.448361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:15.462219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] HTTP exception thrown: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Request method failure captured: Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 HTTP/1.1 Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFyl5_uQ3p2jDudF40ozrMmhTvIGNEfwwB_fXWltDN16gs8DbeWclGLEX6THEgdA4gXkcA3OXijD-cID44bxZC2gqi6-N0wZAgOf2m9N3AEHOtkFyduabvDup6D7A0IGDjCb84P2A-Nn8Wdgv4icvhCalVEyz3FF5qMjwgsBhoQS0M Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 25f51668a0b04e4f9e51d6356b854c7b Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:24:15.464348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/25f51668a0b04e4f9e51d6356b854c7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 25f51668a0b04e4f9e51d6356b854c7b Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-DeleteServersTestJSON-736353905 Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-DeleteServersTestJSON-736353905-project Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: ebf95a8321a249c48d1e7f0b39a067d3 Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-DeleteServersTestJSON-736353905-project Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.465911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': 'd211a1bb-283d-49db-bd1d-b2a7c0d5a691'} Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:24:15.467219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. Aug 09 12:24:15.468665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:24:15.470095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] Returning 404 to user: Instance d211a1bb-283d-49db-bd1d-b2a7c0d5a691 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:24:15.470095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2e3e70f7-c855-44ed-9b20-bccb1615304f tempest-DeleteServersTestJSON-736353905 tempest-DeleteServersTestJSON-736353905-project] 10.222.0.60 "GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691" status: 404 len: 111 microversion: 2.1 time: 0.033462 Aug 09 12:24:15.470095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 155/299] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:15 2022] GET /compute/v2.1/servers/d211a1bb-283d-49db-bd1d-b2a7c0d5a691 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:24:16.291204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:16.292011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:16.298531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:16.299127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:16.299634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:16.300416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:16.301251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:16.301427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:16.522968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:16.531382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c84368e-3ac1-43cf-b158-202271dac0cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.243708 Aug 09 12:24:16.532240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 145/300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:16 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:17.557595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:17.559671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:17.566744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:17.567481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:17.568106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:17.569075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:17.569710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:17.570395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:17.711133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:17.718655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6eeb8e08-8667-41da-9418-98a220a456f5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.168765 Aug 09 12:24:17.719224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 156/301] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:17 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:24:18.739636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:18.740932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:18.750432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:18.750947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:18.751382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:18.752086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:18.752915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:18.758260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:18.967464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:18.975569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3d0128dc-01e6-4bb8-9289-d726e83b544f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.240199 Aug 09 12:24:18.976157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 146/302] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:18 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:19.996887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:19.997458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:20.004069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:20.004564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:20.004987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:20.005698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:20.006133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:20.006559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:20.139008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:20.146469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0197e9e-166e-465b-b62c-1d9e2df9b0c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.153824 Aug 09 12:24:20.147387 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 157/303] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:19 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:21.168814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:21.170256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:21.186506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:21.188288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:21.188933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:21.189933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:21.197400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:21.197903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:21.390230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:21.397984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-06a98fd2-029e-4ea2-b64a-85ce8d2ddc5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.233779 Aug 09 12:24:21.407560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 147/304] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:21 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:22.419214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:22.420670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:22.430872 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:22.431533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:22.433080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:22.433866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:22.435528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:22.436222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:22.606002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:22.618260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a269038-9651-4ff2-b668-8620dbacdfb3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.201683 Aug 09 12:24:22.631996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 158/305] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:22 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:23.646326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:23.647955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:23.655717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:23.656697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:23.657299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:23.658411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:23.658926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:23.659541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:23.853953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:23.866868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5dd54cdc-ea4c-45f6-a78f-21ac60f3b80f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.225940 Aug 09 12:24:23.867676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 148/306] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:23 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:24.833045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-94b1e98c-ce6b-4aeb-9db6-931f5f606277 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'create', calling method: .version_select at 0x7f0e0845c310>, body: {"keypair": {"name": "tempest-keypair-1407050057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMu+RALcwX8AvvBbMODV/a5iClCJKcO1ItPOHxiC2vtB+ep5vou8rIOFJlKuwSYwY5rNQ5h6OiDSr3wyB9uw3R4Tp9ThFB3QoK3C5WNtjSR27edh+dn5QbIVP5DHVlctdA=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:24.854700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-94b1e98c-ce6b-4aeb-9db6-931f5f606277 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Getting quotas for project 12ee39a09d0b4e67898ac55e4fc8aaee. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:24:24.858988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-94b1e98c-ce6b-4aeb-9db6-931f5f606277 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Getting quotas for user b6717f94a3844d1b82817e0f4adcebad and project 12ee39a09d0b4e67898ac55e4fc8aaee. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:24:24.901384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:24.902621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:24.915502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-94b1e98c-ce6b-4aeb-9db6-931f5f606277 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.255083 Aug 09 12:24:24.916365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:24.916883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:24.937679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:24.938575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:24.938753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 159/307] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Aug 9 12:24:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 278 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 12:24:24.940679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:24.941251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:25.173609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:25.182726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a710ab79-5e06-4a3e-a2ac-713ebe9a0024 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1523 microversion: 2.1 time: 0.289299 Aug 09 12:24:25.183282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 149/308] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:24 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:26.210460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:26.212713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:26.221592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:26.222089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:26.222729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:26.223520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:26.224153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:26.224880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:26.606243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:26.616340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-95d9b077-1171-4a70-ab03-047b4519422c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1503 microversion: 2.1 time: 0.414802 Aug 09 12:24:26.617323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 160/309] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:26 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1503 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:26.637384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:26.637973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:26.655914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:26.656675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:26.657290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:26.658130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:26.658743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:26.659156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:26.921453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:26.930062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-df0f8a66-7c84-476e-bfc2-4980525bc745 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1517 microversion: 2.1 time: 0.296605 Aug 09 12:24:26.931974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 150/310] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:26 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1517 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:27.117854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-424557450", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efb3fa22-5bd2-43ad-a594-13a108bbc8d7"}], "security_groups": [{"name": "tempest-securitygroup--1511016057"}], "key_name": "tempest-keypair-1407050057", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:27.250806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] validate_networks() for [('efb3fa22-5bd2-43ad-a594-13a108bbc8d7', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:24:27.795077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:24:27.795633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:24:27.796237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:24:27.796750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:24:27.797466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:24:27.812033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:27.813152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:27.813587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:27.814813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:27.815705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:27.817187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:27.839565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Getting quotas for project 12ee39a09d0b4e67898ac55e4fc8aaee. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:24:27.845213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Getting quotas for user b6717f94a3844d1b82817e0f4adcebad and project 12ee39a09d0b4e67898ac55e4fc8aaee. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:24:27.858349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:24:27.860672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:24:27.912999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e1a8fb4-92a8-4212-97b5-8139ea69a863 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.800756 Aug 09 12:24:27.914166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 161/311] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Aug 9 12:24:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 12:24:27.924985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f6eadd6a-72f6-43c0-98a2-9cfe35c42da8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:27.925604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f6eadd6a-72f6-43c0-98a2-9cfe35c42da8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:27.984395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f6eadd6a-72f6-43c0-98a2-9cfe35c42da8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:28.000210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f6eadd6a-72f6-43c0-98a2-9cfe35c42da8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:28.001937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f6eadd6a-72f6-43c0-98a2-9cfe35c42da8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:28.003417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f6eadd6a-72f6-43c0-98a2-9cfe35c42da8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1281 microversion: 2.20 time: 0.082309 Aug 09 12:24:28.017610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 151/312] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:27 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:29.027070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:29.027668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:29.033716 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:29.034176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:29.034602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:29.035280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:29.035723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:29.036135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:29.096274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:29.105040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:29.106561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:29.107653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-21fd3f6a-3495-49d8-920f-cea8fed6e5c1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1285 microversion: 2.20 time: 0.084637 Aug 09 12:24:29.108357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 162/313] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:29 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:30.138387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:30.138927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:30.141285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=42 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:30.146879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:30.147342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:30.147771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:30.149263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:30.149724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:30.150119 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:30.266251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:30.274847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:30.276341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:30.277723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-356e8f5d-4481-44ec-84b6-aca16623747d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1285 microversion: 2.20 time: 0.143431 Aug 09 12:24:30.278280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 152/314] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:30 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:24:31.301591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:31.302267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:31.321917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:31.321917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:31.323509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:31.324423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:31.325057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:31.325712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:31.329277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:31.407730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:31.428695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:31.430552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:31.431862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e08e3d48-7371-402f-9f43-1f28bd4afe12 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1339 microversion: 2.20 time: 0.135159 Aug 09 12:24:31.448818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 163/315] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:31 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1339 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:32.457867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:32.459256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:32.467173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:32.468098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:32.468914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:32.469880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:32.470552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:32.471195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:32.721391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:32.733529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:32.735477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:32.740282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a83057f5-a112-4260-8930-b4aacd3ab6a0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.288624 Aug 09 12:24:32.741160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 153/316] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:32 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:33.503245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-189945eb-2e95-4891-807f-9fc0142ef547 req-57a016cc-41fe-464d-9f13-a542e3209219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af3fcd4-07fc-4de6-8634-f028e6c4f369", "tag": "2fce29dc-f113-418f-9748-cb44df959451"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:33.515388 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-189945eb-2e95-4891-807f-9fc0142ef547 req-57a016cc-41fe-464d-9f13-a542e3209219 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:33.516251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-189945eb-2e95-4891-807f-9fc0142ef547 req-57a016cc-41fe-464d-9f13-a542e3209219 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:33.516864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-189945eb-2e95-4891-807f-9fc0142ef547 req-57a016cc-41fe-464d-9f13-a542e3209219 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:33.530038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-189945eb-2e95-4891-807f-9fc0142ef547 req-57a016cc-41fe-464d-9f13-a542e3209219 service nova] Creating event network-changed:2fce29dc-f113-418f-9748-cb44df959451 for instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 on hv-cinder-85236 Aug 09 12:24:33.535370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-189945eb-2e95-4891-807f-9fc0142ef547 req-57a016cc-41fe-464d-9f13-a542e3209219 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040041 Aug 09 12:24:33.536905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 164/317] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:24:33.763464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:33.764092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:33.770350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:33.771127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:33.771618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:33.772408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:33.773026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:33.773669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:34.049603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:34.059929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:34.061491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:34.062646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-64f319d2-8773-4bc7-8d63-3c25bfaaea68 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.303054 Aug 09 12:24:34.071677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 154/318] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:33 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:35.093705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:35.095098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:35.104036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:35.104535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:35.104982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:35.105696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:35.106137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:35.106554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:35.340129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:35.349033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:35.351774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:35.354947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-590901dd-5c7b-4c9b-babb-f691e0c60ad2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.263696 Aug 09 12:24:35.354947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 165/319] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:35 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:36.045394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:36.047860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:36.054979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:36.055494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:36.056775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:36.058006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:36.058467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:36.059012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:36.087521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lazy-loading 'flavor' on Instance uuid 138f9e3b-bbbe-4ef3-9108-e66e8911f81c {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:24:36.375406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:36.383288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:36.386718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:36.390771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:36.391728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:36.392638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:36.393755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:36.408066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:36.409067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:36.421060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-33f44a95-13d4-4455-ac8c-bce440c2d2c8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c/action" status: 200 len: 32 microversion: 2.1 time: 0.382921 Aug 09 12:24:36.423365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 155/320] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:24:36 2022] POST /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:24:36.435361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:36.436409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:36.447063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:36.447836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:36.448551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:36.449623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:36.450231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:36.450876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:36.477385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:36.727812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:36.740063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:36.741816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:36.743211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-abdab1d6-fc8d-484f-93a1-6ce40ce1f031 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.371887 Aug 09 12:24:36.743817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 166/321] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:36 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:36.783919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:36.794939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4dc0777a-2c5e-4ece-993e-384906ec299c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.365941 Aug 09 12:24:36.796262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 156/322] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:36 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:37.769363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:37.769925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:37.777582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:37.778069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:37.778495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:37.779193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:37.779634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:37.780043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:37.817869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:37.819828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:37.830721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:37.834014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:37.834742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:37.835296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:37.836138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:37.841292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:37.853215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:37.853663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=10 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:37.989596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:38.097896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:38.118699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:38.120648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:38.121994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6003ee42-f84f-401f-a6e7-a30eebe9f641 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.356960 Aug 09 12:24:38.122883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 167/323] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:37 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:38.145885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:38.157721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-54448245-b9f4-4773-b85f-db9a88ce93c4 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.343746 Aug 09 12:24:38.162383 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 157/324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:37 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:39.149886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:39.150556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:39.160031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:39.160635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:39.161073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:39.161784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:39.162664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:39.164571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:39.179550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:39.180846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:39.191135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:39.197284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:39.197736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:39.198792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:39.202749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:39.204986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:39.783493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:39.796225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:39.798730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:39.800329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-55f443d9-95f6-4c92-bc0b-057edfa47dd6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.654590 Aug 09 12:24:39.812410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 168/325] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:39 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:39.836525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:39.847056 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-94e44917-c7de-4a96-85ed-d9fcb16fa82d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.671659 Aug 09 12:24:39.863006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 158/326] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:39 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:40.824633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:40.825165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:40.835198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:40.836769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:40.843539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:40.844669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:40.845288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:40.846204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:40.872311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:40.872959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:40.880266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:40.900544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:40.901006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:40.901821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:40.902200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:40.902625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:41.253590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:41.270544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:41.272540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:41.289921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30610849-3da7-44ce-8592-087237b0e43d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.469206 Aug 09 12:24:41.301778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:41.305363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 169/327] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:40 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:41.311644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c62ac81e-7827-42eb-9652-9619b64a5382 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.443399 Aug 09 12:24:41.312451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 159/328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:40 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:42.314773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:42.316049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:42.324588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:42.325246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:42.325830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:42.326604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:42.327202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:42.327624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:42.334867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:42.336087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:42.343607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:42.344319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:42.345476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:42.349049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:42.349826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:42.350580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:42.626533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:42.637050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:42.642393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:42.651704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:42.654026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46fd6f72-9bf5-4fcc-b73a-53123f57cbf5 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.323394 Aug 09 12:24:42.654723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 160/329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:42 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:42.655643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34789c53-1e57-47f3-ac91-5210561c0ee3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.345099 Aug 09 12:24:42.668880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 170/330] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:42 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:43.680330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:43.681925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:43.682154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:43.683036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:43.692024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:43.695717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:43.696306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:43.696986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:43.699414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:43.699737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:43.703155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:43.703532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:43.706341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:43.706553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:43.708117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:43.708782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:44.030650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:44.034993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:44.039980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20084566-d492-43c8-bb55-36ad1bcdb49c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.362414 Aug 09 12:24:44.043011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 161/331] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:43 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:44.055918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:44.055918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:44.055918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-12c6305d-08a8-40bc-bcb1-255fba6e4c63 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.372286 Aug 09 12:24:44.060653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 171/332] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:43 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:45.063242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:45.064679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:45.071243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:45.071896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:45.073336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:45.074227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:45.074834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:45.077442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:45.077442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:45.078088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:45.078241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:45.078856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:45.079445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:45.080301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:45.081133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:45.081699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:45.299078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:45.311266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8ff11fb4-21c7-4401-a937-cfcfffd535b0 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.251834 Aug 09 12:24:45.316259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 162/333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:45 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:45.343288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:45.358702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:45.360447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:45.361811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e3ce5370-36cb-49c5-8584-94616b9e9a22 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.294688 Aug 09 12:24:45.377441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 172/334] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:45 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:24:46.341558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:46.342183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:46.348945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:46.349418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:46.350035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:46.351121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:46.351731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:46.352144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:46.386095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:46.388062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:46.397727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:46.398856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:46.399551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:46.400352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:46.400914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:46.401436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:46.556598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:46.567229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-39483841-90e0-422c-8859-ac8b1ee3e230 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.229666 Aug 09 12:24:46.568729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 163/335] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:46 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:46.626339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:46.641284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:46.644769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:46.645927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-87ce8cd8-76da-43b5-828d-a4644fad6d5a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.263937 Aug 09 12:24:46.646470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 173/336] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:46 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:24:47.128410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-91832d8b-2492-4b24-991b-5b833d604b3b req-1489d616-a05b-4670-93a9-53431a2ae4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af3fcd4-07fc-4de6-8634-f028e6c4f369", "name": "network-vif-plugged", "status": "completed", "tag": "2fce29dc-f113-418f-9748-cb44df959451"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:47.141587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-91832d8b-2492-4b24-991b-5b833d604b3b req-1489d616-a05b-4670-93a9-53431a2ae4a5 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:47.142607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-91832d8b-2492-4b24-991b-5b833d604b3b req-1489d616-a05b-4670-93a9-53431a2ae4a5 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:47.143263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-91832d8b-2492-4b24-991b-5b833d604b3b req-1489d616-a05b-4670-93a9-53431a2ae4a5 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:47.158142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-91832d8b-2492-4b24-991b-5b833d604b3b req-1489d616-a05b-4670-93a9-53431a2ae4a5 service nova] Creating event network-vif-plugged:2fce29dc-f113-418f-9748-cb44df959451 for instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 on hv-cinder-85236 Aug 09 12:24:47.165348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-91832d8b-2492-4b24-991b-5b833d604b3b req-1489d616-a05b-4670-93a9-53431a2ae4a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042946 Aug 09 12:24:47.166943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 164/337] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:24:47.593819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:47.595329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:47.604534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:47.605898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:47.606627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:47.607451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:47.608027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:47.608594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:47.676653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:47.676653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:47.691388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:47.693135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:47.693611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:47.697130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:47.712876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:47.713712 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:47.918233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:47.926497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8494121f-5ece-4d6f-8dae-9e61e662b70a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.339392 Aug 09 12:24:47.927199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 174/338] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:47 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:24:47.951520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:47.960494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:47.961934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:47.963062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-44b8047f-e14e-41f3-a8a0-5ede2922a693 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.297632 Aug 09 12:24:47.978699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 165/339] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:47 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:24:48.951235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:48.953194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:48.964046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:48.966310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:48.966922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:48.967804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:48.970413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:48.971164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:48.987666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:48.988950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:49.007375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:49.008195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:49.008838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:49.009752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:49.010388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:49.010989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:49.263971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:49.280644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:49.282691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:49.291511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aaea23dc-31dd-43e3-addb-f8c6d3b92fe3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1407 microversion: 2.20 time: 0.307981 Aug 09 12:24:49.292799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 166/340] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:48 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:24:49.293456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:49.302857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2c63439-196a-4b82-b90e-8f57da49251f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.357211 Aug 09 12:24:49.316524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 175/341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:48 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:50.318776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:50.319287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:50.326102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:50.326822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:50.327986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:50.328487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:50.335125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:50.335878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:50.336461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:50.341438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:50.350391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:50.350645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:50.351439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:50.352457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:50.355344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:50.356029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:50.552675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:50.567513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:50.578661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:50.579971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-50264fdc-4a87-46d3-a97e-488988232079 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1598 microversion: 2.20 time: 0.266194 Aug 09 12:24:50.584503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 167/342] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:24:50 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1598 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:24:50.607564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:50.609287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:50.611741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:50.620260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a913abcd-8fc2-4316-97a6-eea296412eea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.298038 Aug 09 12:24:50.621362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:50.621943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:50.622417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 176/343] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:50 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:50.622643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:50.623338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:50.623830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:50.624247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:50.719303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-84d1158f-c3a1-43a4-a793-8ed9a12c3538 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.119775 Aug 09 12:24:50.719936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 168/344] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Aug 9 12:24:50 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 12:24:51.644307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:51.645655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:51.659898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:51.660430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:51.660894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:51.661592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:51.662714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:51.663498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:52.248738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:52.264886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f230fb28-e782-4dae-b8d5-778733e19cdb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.624507 Aug 09 12:24:52.284772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 177/345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:51 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:52.458378 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-6f32ec8a-85bf-4ec8-b055-1fcadfab82ca req-ccc73cc2-6e63-4c3c-a43f-edba82cd8f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af3fcd4-07fc-4de6-8634-f028e6c4f369", "tag": "2fce29dc-f113-418f-9748-cb44df959451"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:52.472471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-6f32ec8a-85bf-4ec8-b055-1fcadfab82ca req-ccc73cc2-6e63-4c3c-a43f-edba82cd8f8c service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:52.473437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-6f32ec8a-85bf-4ec8-b055-1fcadfab82ca req-ccc73cc2-6e63-4c3c-a43f-edba82cd8f8c service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:52.474053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-6f32ec8a-85bf-4ec8-b055-1fcadfab82ca req-ccc73cc2-6e63-4c3c-a43f-edba82cd8f8c service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:52.493238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-6f32ec8a-85bf-4ec8-b055-1fcadfab82ca req-ccc73cc2-6e63-4c3c-a43f-edba82cd8f8c service nova] Creating event network-changed:2fce29dc-f113-418f-9748-cb44df959451 for instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 on hv-cinder-85236 Aug 09 12:24:52.505343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-6f32ec8a-85bf-4ec8-b055-1fcadfab82ca req-ccc73cc2-6e63-4c3c-a43f-edba82cd8f8c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055216 Aug 09 12:24:52.506361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 169/346] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:24:52.701156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-904bf76b-6bc3-4391-916d-633d47c9bc4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Action: 'create', calling method: .version_select at 0x7f0e08471700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1524939798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtv3MvjffbG3HdqhbASwSxq5hdWnKrc7LZ6p3u2QpnMc0boScrQL7DyMpdHDYBiKyLKKlSHs/thyUKV8GUqnRF1wHQZ0ZY8uw4G0/FQ/mCznGtDeqE8FD+CnKJFpZ0XVw=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:52.743516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-904bf76b-6bc3-4391-916d-633d47c9bc4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Getting quotas for project 125ff55150f6403ba0bccb148121a688. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:24:52.749616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-904bf76b-6bc3-4391-916d-633d47c9bc4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Getting quotas for user 483f96224f6040a98940f769e30d0e60 and project 125ff55150f6403ba0bccb148121a688. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:24:52.795591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-904bf76b-6bc3-4391-916d-633d47c9bc4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.098697 Aug 09 12:24:52.796610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 178/347] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:24:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:24:52.941358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-105211873", "imageRef": "515ea628-c2e0-4e3f-949b-771cf753fcf8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1524939798", "networks": [{"uuid": "8a06e2c5-1b25-4e56-be00-0b1a64d19749"}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:53.027832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] validate_networks() for [('8a06e2c5-1b25-4e56-be00-0b1a64d19749', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:24:53.286671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:53.288913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:53.300007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:53.300842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:53.301612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:53.302661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:53.303575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:53.304291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:53.646016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:24:53.648463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:24:53.649188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:24:53.649948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:24:53.651143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:24:53.668740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:53.669753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:53.670972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:53.672564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:53.673835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:53.675692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:53.676496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:53.681643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-377ee17f-0b86-4912-828c-53b7659dfc3d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.399320 Aug 09 12:24:53.682956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 179/348] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:53 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:24:53.704670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Getting quotas for project 125ff55150f6403ba0bccb148121a688. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:24:53.709788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Getting quotas for user 483f96224f6040a98940f769e30d0e60 and project 125ff55150f6403ba0bccb148121a688. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:24:53.724881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:24:53.727332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='515ea628-c2e0-4e3f-949b-771cf753fcf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:24:53.794192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dd2afed1-2f4b-43e1-83e1-6ec894106b4a tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858068 Aug 09 12:24:53.795870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 170/349] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:24:53.806093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5639bb0-19d0-42c0-94ca-04432a832a67 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:53.806692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5639bb0-19d0-42c0-94ca-04432a832a67 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:53.901992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5639bb0-19d0-42c0-94ca-04432a832a67 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:53.911167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5639bb0-19d0-42c0-94ca-04432a832a67 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1258 microversion: 2.1 time: 0.108994 Aug 09 12:24:53.932358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 180/350] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:53 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1258 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:54.703998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:54.704438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:54.713952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:54.714410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:54.714835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:54.715680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:54.716547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:54.717223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:54.881756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:54.889995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e129dbbe-0c03-4a8b-8e94-06d1eee3332c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.190687 Aug 09 12:24:54.891119 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 171/351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:54 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:54.933029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:54.933746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:54.940852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:54.941482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:54.941985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:54.943754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:54.945033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:54.945557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:55.012493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:55.020547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-930479e0-b404-4cef-a757-84106be222c4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1262 microversion: 2.1 time: 0.091836 Aug 09 12:24:55.021463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 181/352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:54 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:55.913687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:55.914315 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:55.921157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:55.921634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:55.922059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:55.922737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:55.923181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:55.923592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.041678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:56.042276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:56.048497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:56.048980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:56.049445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.050119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:56.050579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:56.050984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.056538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:56.064638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eb1b9910-f639-4938-9c40-3d6cfea66b0f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1503 microversion: 2.1 time: 0.157395 Aug 09 12:24:56.065681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 172/353] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:55 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:56.066516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:56.086207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2034b6b8-940f-4b95-bbf5-61219e9e2d19"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:56.088846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:56.095301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:56.095758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:56.096189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.096938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:56.097388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:56.097807 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.117282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:56.123382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] HTTP exception thrown: Cannot 'attach_volume' instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c while it is in vm_state rescued Aug 09 12:24:56.124677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2325df6c-9b8c-4f83-8785-42452d268e49 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1310 microversion: 2.1 time: 0.087080 Aug 09 12:24:56.125263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 182/354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:56 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Request method failure captured: Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: POST /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c/os-volume_attachments HTTP/1.1 Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 74 Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFwgTp7Ky4KsSeKussN4JpllXGcA1oE4ep9CmV_KrFjQ5_NHiPKAtZFe7YvIK5gtA50qs5EI_NWt1Aeupm7u7-he8BxlzPHoSBB0qV9cTRogMVoES4LvcNS13xSQkS9EN0aDzIpI6NMih3bZ0TP8CzJD4XYJ8jSni7cAYmPn_PlDhw Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: eec8510663e74669969800e60e6c422b Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:24:56.125573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eec8510663e74669969800e60e6c422b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eec8510663e74669969800e60e6c422b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: eec8510663e74669969800e60e6c422b Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 7dcda8b6ba32416c86b329e2a4ee41e5 Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {"volumeAttachment": {"volumeId": "2034b6b8-940f-4b95-bbf5-61219e9e2d19"}} Aug 09 12:24:56.127493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Cannot 'attach_volume' instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c while it is in vm_state rescued Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '138f9e3b-bbbe-4ef3-9108-e66e8911f81c', 'body': {'volumeAttachment': {'volumeId': '2034b6b8-940f-4b95-bbf5-61219e9e2d19'}}} Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:24:56.128388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c while it is in vm_state rescued Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:24:56.129771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:24:56.131030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:24:56.131030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:24:56.131030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c while it is in vm_state rescued Aug 09 12:24:56.131030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:24:56.131030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Returning 409 to user: Cannot 'attach_volume' instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c while it is in vm_state rescued {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:24:56.131030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a7dc9a17-3f00-4c29-9975-12e7b90f461f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045477 Aug 09 12:24:56.131519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 173/355] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:24:56 2022] POST /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 12:24:56.141356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:24:56.141807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:56.148016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:56.148893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:56.149385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.150117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:56.150571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:56.151023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.230250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6b54a64-d134-4584-9b9b-3dc41b1e838d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c/action" status: 202 len: 0 microversion: 2.1 time: 0.092436 Aug 09 12:24:56.230980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 183/356] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:24:56 2022] POST /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:24:56.238981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:56.239612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:56.246706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:56.247178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:56.247611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.248309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:56.248780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:56.249197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:56.573567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:56.582516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-461efb02-1481-4ec3-a868-0286758567f7 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.347212 Aug 09 12:24:56.583202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 174/357] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:56 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:57.151623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:57.152724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:57.168488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:57.169087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:57.170685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:57.171555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:57.172588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:57.173422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:57.266669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:57.288637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c6b94f0f-a80f-4dbc-a857-e8513051a275 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1316 microversion: 2.1 time: 0.144866 Aug 09 12:24:57.307209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 184/358] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:57 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:57.605117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:57.605882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:57.616217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:57.622183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:57.622752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:57.623743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:57.627360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:57.627886 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:57.664099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:57.855864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:57.870542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-414f4624-27a8-479b-a71d-7c478ac3a544 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.269911 Aug 09 12:24:57.880265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 175/359] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:57 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:58.315603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:58.316260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:58.323240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:58.323767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:58.324468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:58.325455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:58.326072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:58.326789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:58.466730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:58.474337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dff607b6-2d12-45f0-8792-9411ced97f96 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.163080 Aug 09 12:24:58.475596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 185/360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:58 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:58.898809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:58.899360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:58.910239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:58.910707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:58.911312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:58.912183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:58.912932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:58.913774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:59.058247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:59.066079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f22299e3-105b-4e51-bcb1-cf8d632a8594 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.171919 Aug 09 12:24:59.066663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 176/361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:58 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:24:59.496135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:24:59.498376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:24:59.505986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:59.506490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:59.507070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:59.507972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:24:59.508435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:24:59.508874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:24:59.652598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:24:59.661116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-87ec688f-0391-40a8-9f69-0f2827f807bd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.168779 Aug 09 12:24:59.661950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 186/362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:24:59 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:00.088727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:00.089496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:00.096200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:00.096639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:00.097091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:00.097788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:00.098229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:00.098678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:00.250584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:00.260305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0f2fa302-56b0-4224-9ccb-a7798fffdb74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.176796 Aug 09 12:25:00.261219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 177/363] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:00 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:00.683239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:00.683926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:00.690808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:00.691470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:00.692077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:00.693228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:00.693910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:00.694621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:00.856711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:00.864974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-609ac5a0-912c-4996-a46d-6ed4760aba2b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.185926 Aug 09 12:25:00.865585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 187/364] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:00 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:01.292021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:01.292689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:01.295171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:01.299888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:01.300366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:01.300830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:01.301519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:01.301973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:01.302365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:01.452015 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:01.459575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-83e786d7-102f-4a18-9542-2829fa0b09ac tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.177355 Aug 09 12:25:01.460144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 178/365] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:01 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:01.887023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:01.888277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:01.894472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:01.894977 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:01.895406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:01.896102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:01.896583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:01.897000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:02.066737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:02.074935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6331a607-eac3-40e9-accc-34837366a05c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.191882 Aug 09 12:25:02.075782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 188/366] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:01 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:02.480437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:02.481043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:02.488365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:02.488885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:02.489359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:02.490071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:02.490526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:02.490947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:02.995140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:03.004012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-07194560-f631-46c5-b30e-8f7a304dc125 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.527690 Aug 09 12:25:03.009553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 179/367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:02 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:03.095783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:03.097180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:03.107306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:03.107824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:03.108277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:03.109085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:03.109571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:03.110018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:03.289709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:03.298516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc91dfd8-1161-4340-be93-fc95ab29201b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.207184 Aug 09 12:25:03.299418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 189/368] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:03 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:04.036492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:04.037178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:04.039995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:04.040728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=6 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:04.047212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:04.047707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:04.048464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:04.049325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:04.050042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:04.050639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:04.212670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:04.220823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b6528838-d777-47b1-bda0-ee583aea166b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.197266 Aug 09 12:25:04.221430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 180/369] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:04 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:04.322632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:04.323399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:04.325728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:04.331319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:04.331803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:04.332226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:04.332973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:04.333418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:04.333827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:04.612857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:04.621235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a343970e-8d61-4536-baf0-8cc1ed6e7ea4 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.303927 Aug 09 12:25:04.621849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 190/370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:04 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:05.242329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:05.243170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:05.251178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:05.252199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:05.252661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:05.253557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:05.254004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:05.254449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:05.458343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:05.467973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4dcb61a1-30e3-46c8-89ae-74e3a0ec1c98 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.230288 Aug 09 12:25:05.476432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 181/371] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:05 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:05.645465 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:05.646075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:05.653347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:05.653900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:05.654390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:05.655194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:05.655702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:05.656129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:05.795002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:05.807142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2741d00e-c21d-4cae-b397-55b3cc4ea959 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.166232 Aug 09 12:25:05.807712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 191/372] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:05 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:06.490212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:06.490848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:06.498755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:06.499295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:06.499924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:06.500638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:06.501083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:06.501502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:06.633507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:06.641679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e4b2e8b5-d6a8-46d0-a09b-35283517ad93 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.155288 Aug 09 12:25:06.642170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 182/373] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:06 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:06.829320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:06.829980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:06.832779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:06.840705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:06.841413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:06.842378 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:06.843380 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:06.844001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:06.844647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:06.983443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:06.990870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a8ee49b-6556-4962-a943-bbc0064fcaa3 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.166656 Aug 09 12:25:06.991423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 192/374] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:06 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:07.664230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:07.665207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:07.672031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:07.672707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:07.673143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:07.673825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:07.674255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:07.674690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:07.805067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:07.813151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a3900f98-83bb-4b4d-b371-ede0acb48f1d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.154198 Aug 09 12:25:07.813696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 183/375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:07 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:08.016217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:08.017273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:08.026483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:08.026957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:08.027381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:08.028071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:08.028544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:08.028961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:08.159297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:08.167743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd9fdfa5-c162-498c-b8d5-7079f68a5405 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.157982 Aug 09 12:25:08.168303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 193/376] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:08 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:08.834470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:08.835024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:08.842303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:08.842791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:08.843220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:08.843922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:08.844373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:08.844811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:08.993435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:09.001431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a08c693b-b120-4d3f-b41f-6d12bbbdc883 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.170940 Aug 09 12:25:09.002366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 184/377] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:08 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:09.192467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:09.193689 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:09.202355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:09.202830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:09.203257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:09.203941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:09.204405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:09.204823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:09.346702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:09.354484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eac5405c-aa75-4fa0-ba92-17f510e229f5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.168693 Aug 09 12:25:09.355018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 194/378] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:09 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:10.023426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:10.024314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:10.033183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:10.033664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:10.034006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:10.034707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:10.035160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:10.035594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:10.202853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:10.210803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dd3f4a1b-9224-4e1a-90c2-0ff0435e848b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.191337 Aug 09 12:25:10.216526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 185/379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:10 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:10.377932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:10.378497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:10.384715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:10.385203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:10.385640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:10.386335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:10.386786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:10.387239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:10.517254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:10.525516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-98686176-b21f-4af1-9c70-92b75453b210 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.151926 Aug 09 12:25:10.526097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 195/380] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:10 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:11.233568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:11.234339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:11.240923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:11.241406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:11.241834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:11.242527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:11.243390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:11.243827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:11.386489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:11.394052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-273436da-e6af-4775-9058-9507651daa74 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.165016 Aug 09 12:25:11.394616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 186/381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:11 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:11.546807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:11.547393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:11.553920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:11.554395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:11.554823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:11.555510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:11.556462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:11.556824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:11.697516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:11.705235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fdf0389f-54ea-4192-a0fa-f04105632fd6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.162359 Aug 09 12:25:11.705793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 196/382] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:11 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:12.419611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:12.420424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:12.429216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:12.429854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:12.430426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:12.431337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:12.432058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:12.432679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:12.585981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:12.594095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b8eaa2e5-b237-47a7-a1d8-fb8caa12552b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.180150 Aug 09 12:25:12.594661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 187/383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:12 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:12.731733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:12.732624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:12.742686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:12.743738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:12.744167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:12.744880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:12.745326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:12.745742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:12.877725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:12.885603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-05bd0930-2a20-478a-b661-e00847788a07 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.160637 Aug 09 12:25:12.892440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 197/384] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:12 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:13.616414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:13.617293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:13.624286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:13.624841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:13.625269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:13.626216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:13.627291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:13.627869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:13.869022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:13.876832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c5036445-4ce1-431b-9fb4-942367dd46f1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.264671 Aug 09 12:25:13.889510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 188/385] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:13 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:13.911256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:13.912078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:13.921435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:13.922052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:13.922587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:13.923626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:13.924260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:13.924893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:13.946194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:14.033061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-7313f3ce-b0b4-480c-a52b-6199d341c193 req-b2b35e6f-f423-43b0-9530-513d9258876b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1dbad9-b1fa-4279-b87e-d19ee96ba798", "tag": "b92622b3-9938-4ed9-bd50-a1d8ff86458f"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:14.042370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7313f3ce-b0b4-480c-a52b-6199d341c193 req-b2b35e6f-f423-43b0-9530-513d9258876b service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:14.042916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7313f3ce-b0b4-480c-a52b-6199d341c193 req-b2b35e6f-f423-43b0-9530-513d9258876b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:14.043420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7313f3ce-b0b4-480c-a52b-6199d341c193 req-b2b35e6f-f423-43b0-9530-513d9258876b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:14.055283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-7313f3ce-b0b4-480c-a52b-6199d341c193 req-b2b35e6f-f423-43b0-9530-513d9258876b service nova] Creating event network-changed:b92622b3-9938-4ed9-bd50-a1d8ff86458f for instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 on hv-cinder-85236 Aug 09 12:25:14.061785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-7313f3ce-b0b4-480c-a52b-6199d341c193 req-b2b35e6f-f423-43b0-9530-513d9258876b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031663 Aug 09 12:25:14.062130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 189/386] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:25:14.129171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:14.149706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-563ed9e6-c3d7-47d8-ac0a-512716574e59 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.234461 Aug 09 12:25:14.156558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 198/387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:13 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:14.900577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:14.901307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:14.907551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:14.908041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:14.908498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:14.909166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:14.909642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:14.910064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:15.047032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:15.055470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4d3f6e5b-c7a6-46c2-828f-7be52576e599 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.159907 Aug 09 12:25:15.056740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 190/388] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:14 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:15.179187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:15.179855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:15.186235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:15.186794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:15.187296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:15.188074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:15.188563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:15.188986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:15.330884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:15.338997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa6fc112-8e9b-44c0-bfe1-0ddc7ac109a6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.163648 Aug 09 12:25:15.339562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 199/389] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:15 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:16.083084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:16.084067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:16.094857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:16.095656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:16.096425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:16.097563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:16.098312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:16.099015 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:16.236846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:16.247151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-efb3faee-9eda-4a28-aea1-a6a0e19f3337 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1511 microversion: 2.1 time: 0.170694 Aug 09 12:25:16.247729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 191/390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:16 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:16.362173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:16.362767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:16.371006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:16.371493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:16.371927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:16.372656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:16.373091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:16.373510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:16.564467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:16.588361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ffc067ec-44e9-48fc-b314-29a6763a0382 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.219504 Aug 09 12:25:16.588361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 200/391] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:16 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:17.270494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:17.271063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:17.280009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:17.280515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:17.280944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:17.281624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:17.282064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:17.282478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:17.415186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:17.418785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:17.423277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-979b0f88-95bd-4642-9836-5d7955265603 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1517 microversion: 2.1 time: 0.159040 Aug 09 12:25:17.423860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 192/392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:17 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:17.598179 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:17.598786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:17.605843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:17.605843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:17.606392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:17.606986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:17.607444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:17.607828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:17.899684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:17.908039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de3594ab-c112-4f6a-8e64-d6ba966e1114 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.313661 Aug 09 12:25:17.908998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 201/393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:17 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:18.842691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-059a7a5b-b24c-4283-bddf-90304ddf81e1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'create', calling method: .version_select at 0x7f0e0842d160>, body: {"keypair": {"name": "tempest-keypair-1888601664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1tZ9lppqbK0PSkghrkOg+mZyr6jzk6lW3dzMQ1c/1Ik35bM/c/lL81sgZ82MjtatlN14VSTStLKZbODev57b2dRVYJlL+yHlQg/uCrnkHw/aNSziXxxJwPM5kL8UtE0Q=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:18.859358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-059a7a5b-b24c-4283-bddf-90304ddf81e1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Getting quotas for project eec8510663e74669969800e60e6c422b. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:25:18.863564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-059a7a5b-b24c-4283-bddf-90304ddf81e1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Getting quotas for user 7dcda8b6ba32416c86b329e2a4ee41e5 and project eec8510663e74669969800e60e6c422b. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:25:18.875880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR oslo.messaging._drivers.impl_rabbit [None req-059a7a5b-b24c-4283-bddf-90304ddf81e1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [6289331a-38d0-440d-9534-63cc2106d14b] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 12:25:18.928957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:18.929555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:18.935763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:18.936234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:18.936688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:18.937363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:18.937806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:18.938216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:19.074043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:19.085840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-28f10ccd-3b26-4ef6-98ef-4eab51c1b83e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.160627 Aug 09 12:25:19.086679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 202/394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:18 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:19.884778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [None req-059a7a5b-b24c-4283-bddf-90304ddf81e1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [6289331a-38d0-440d-9534-63cc2106d14b] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 60698. Aug 09 12:25:19.904995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-059a7a5b-b24c-4283-bddf-90304ddf81e1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.066375 Aug 09 12:25:19.905741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 193/395] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:25:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:25:20.113747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:20.114426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:20.120710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:20.124552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:20.125185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:20.128622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:20.129315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:20.129937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:20.312307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:20.329118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-550ef1a8-ee05-459d-9dd9-820762afbf93 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.219835 Aug 09 12:25:20.329706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 203/396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:20 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:21.351254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:21.351874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:21.359566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:21.360252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:21.360919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:21.362905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:21.363641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:21.364115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:21.443312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-818706019", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c034b69-24d1-4acf-bbe5-be306b507d95"}], "security_groups": [{"name": "tempest-securitygroup--1521311135"}], "key_name": "tempest-keypair-1888601664", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:21.505458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:21.512987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9b4d151b-37fe-4ba8-b57b-4e9a721de0c5 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.166143 Aug 09 12:25:21.513554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 194/397] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:21 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:21.555726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] validate_networks() for [('9c034b69-24d1-4acf-bbe5-be306b507d95', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:25:22.000431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:25:22.008433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:25:22.008433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:25:22.008433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:25:22.008433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:25:22.015863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:22.016469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:22.017623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:22.018464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:22.019004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:22.019704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:22.037999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Getting quotas for project eec8510663e74669969800e60e6c422b. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:25:22.041990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Getting quotas for user 7dcda8b6ba32416c86b329e2a4ee41e5 and project eec8510663e74669969800e60e6c422b. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:25:22.053111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:25:22.055399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:25:22.103712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9e4bfe64-2765-4d61-9c5c-ce46bd52cb3c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.664727 Aug 09 12:25:22.104606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 204/398] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:25:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:25:22.115909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-000abb53-7e14-4f76-9c0b-455da973bf2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:22.116634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-000abb53-7e14-4f76-9c0b-455da973bf2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:22.173600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-000abb53-7e14-4f76-9c0b-455da973bf2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:22.181767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-000abb53-7e14-4f76-9c0b-455da973bf2b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1245 microversion: 2.1 time: 0.069910 Aug 09 12:25:22.182386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 195/399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:22 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:22.536085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:22.536852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:22.547284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:22.547639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:22.548065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:22.548783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:22.549225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:22.549743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:22.725157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:22.733046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ea9c28a-e68b-42a9-b1ed-c07ab8bd8804 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.201592 Aug 09 12:25:22.733622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 205/400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:22 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:23.205226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:23.206683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:23.214729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:23.215364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:23.215909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:23.216650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:23.217103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:23.217758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:23.288413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:23.296135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ccd1d20-8a35-4943-b217-e5d8e3fc864f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1297 microversion: 2.1 time: 0.094892 Aug 09 12:25:23.297269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 196/401] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:23 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:23.515701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-17712226-77b9-49c6-a0e4-08db154c6364 req-8c73b797-3bf4-47c7-85a6-ba5641ad7a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1dbad9-b1fa-4279-b87e-d19ee96ba798", "name": "network-vif-plugged", "status": "completed", "tag": "b92622b3-9938-4ed9-bd50-a1d8ff86458f"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:23.535537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-17712226-77b9-49c6-a0e4-08db154c6364 req-8c73b797-3bf4-47c7-85a6-ba5641ad7a02 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:23.536585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-17712226-77b9-49c6-a0e4-08db154c6364 req-8c73b797-3bf4-47c7-85a6-ba5641ad7a02 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:23.543289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-17712226-77b9-49c6-a0e4-08db154c6364 req-8c73b797-3bf4-47c7-85a6-ba5641ad7a02 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:23.558222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-17712226-77b9-49c6-a0e4-08db154c6364 req-8c73b797-3bf4-47c7-85a6-ba5641ad7a02 service nova] Creating event network-vif-plugged:b92622b3-9938-4ed9-bd50-a1d8ff86458f for instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 on hv-cinder-85236 Aug 09 12:25:23.569094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-17712226-77b9-49c6-a0e4-08db154c6364 req-8c73b797-3bf4-47c7-85a6-ba5641ad7a02 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052533 Aug 09 12:25:23.576678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 206/402] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:25:23.759174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:23.759779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:23.767828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:23.768514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:23.768941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:23.769632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:23.770241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:23.770841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:24.037116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:24.049377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0a30a258-4926-46d4-acbc-c5cb4151b247 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.298091 Aug 09 12:25:24.050141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 197/403] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:23 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:24.318833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:24.319547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:24.326589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:24.327336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:24.327866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:24.328735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:24.329292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:24.329806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:24.415130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:24.423175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0a03e81a-f958-4839-9c05-344770381b20 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1303 microversion: 2.1 time: 0.108822 Aug 09 12:25:24.423669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 207/404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:24 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:25.070849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:25.071570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:25.078942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:25.079552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:25.080057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:25.080912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:25.081456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:25.082360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:25.282666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:25.290330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1c31abed-536e-4c24-acee-ff0d6bc431b6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1358 microversion: 2.1 time: 0.223292 Aug 09 12:25:25.290997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 198/405] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:25 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:25.381217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-1e6e7b3d-641c-4e30-a7a3-3a155a633f23 req-be456543-b41d-4ca1-b62c-4dbe1cd679e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839a46e0-41c6-4467-b9fe-a7c9a478c27c", "tag": "889c08ff-7822-4d8e-abf6-46dfadd00efd"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:25.391953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1e6e7b3d-641c-4e30-a7a3-3a155a633f23 req-be456543-b41d-4ca1-b62c-4dbe1cd679e3 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:25.392445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1e6e7b3d-641c-4e30-a7a3-3a155a633f23 req-be456543-b41d-4ca1-b62c-4dbe1cd679e3 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:25.393043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1e6e7b3d-641c-4e30-a7a3-3a155a633f23 req-be456543-b41d-4ca1-b62c-4dbe1cd679e3 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:25.407752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-1e6e7b3d-641c-4e30-a7a3-3a155a633f23 req-be456543-b41d-4ca1-b62c-4dbe1cd679e3 service nova] Creating event network-changed:889c08ff-7822-4d8e-abf6-46dfadd00efd for instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c on hv-cinder-85236 Aug 09 12:25:25.413310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-1e6e7b3d-641c-4e30-a7a3-3a155a633f23 req-be456543-b41d-4ca1-b62c-4dbe1cd679e3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036489 Aug 09 12:25:25.414067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 208/406] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:25:25.446181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:25.447134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:25.455065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:25.455544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:25.456233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:25.456716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:25.457210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:25.457664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:25.608619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:25.618640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7297cf6a-07c5-42fe-867d-bd005375e378 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.176222 Aug 09 12:25:25.619212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 199/407] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:25 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:26.312688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:26.313242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:26.319475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:26.320188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:26.320703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:26.321620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:26.322154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:26.322578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:26.526784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:26.534930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-158ec2a3-f71d-44e2-b517-80cc22fdf64e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1548 microversion: 2.1 time: 0.227291 Aug 09 12:25:26.535401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 209/408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:26 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:26.556844 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:26.557439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:26.564460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:26.564939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:26.565363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:26.566053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:26.566523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:26.566937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:26.640614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:26.641815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:26.648029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:26.648704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:26.649191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:26.650027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:26.650574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:26.651065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:27.070880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:27.079416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-35746149-003f-4343-b72f-1d719d528e16 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1548 microversion: 2.1 time: 0.526520 Aug 09 12:25:27.080621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 200/409] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:26 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1548 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:27.100467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:27.105445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:27.106329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Searching by: {'deleted': False, 'project_id': '125ff55150f6403ba0bccb148121a688'} {{(pid=117661) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 12:25:27.113067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:27.113529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:27.113963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:27.114675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:27.115132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:27.115547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:27.157147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:27.165070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-afacc7fc-33d6-450c-9474-40344ffccc7a tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.529465 Aug 09 12:25:27.168788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 210/410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:26 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:27.206492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.multi_cell_list [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117661) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 12:25:27.312125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cd718dc4-6771-4699-8677-fac9a3521288 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215422 Aug 09 12:25:27.312944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 201/411] 10.222.0.60 () {58 vars in 1125 bytes} [Tue Aug 9 12:25:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:25:27.326043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:27.326729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:27.333200 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:27.333683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:27.334115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:27.334842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:27.335306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:27.335735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:27.490212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:27.498064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c48df403-e3b8-4a86-af0e-d97c1882384f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1548 microversion: 2.1 time: 0.177618 Aug 09 12:25:27.498640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 211/412] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:27 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:28.186596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:28.187140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:28.195430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:28.196109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:28.196722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:28.197729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:28.198293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:28.198789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:28.341898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:28.350013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0292748e-e1c5-4d24-86fa-9b5f8caade8e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.167624 Aug 09 12:25:28.350556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 202/413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:28 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:29.370867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:29.371526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:29.378502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:29.378983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:29.379417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:29.380105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:29.380602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:29.381027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:29.525092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:29.533011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e40ce80e-622b-4c8c-b270-5ecf02b293ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.166135 Aug 09 12:25:29.533583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 212/414] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:29 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:30.176090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1af7ec6e-b6e4-4df7-b1a0-96f4e981a389"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:30.178726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:30.185798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:30.186360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:30.186804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:30.187488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:30.187931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:30.188347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:30.556869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:30.557482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:30.564945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:30.565420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:30.565852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:30.566535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:30.566980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:30.567392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:30.708975 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:30.719951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76fe8625-f7a8-438b-881e-7526cb44f941 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.169266 Aug 09 12:25:30.720560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 213/415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:30 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:31.388271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce1e4037-bb90-48a7-9c06-329ed185521f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "POST /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.216385 Aug 09 12:25:31.389781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 203/416] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:25:30 2022] POST /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments => generated 194 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:25:31.740908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:31.741434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:31.747764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:31.748239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:31.748776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:31.749461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:31.749907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:31.750327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:31.887556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:31.895728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64d5f62d-453a-4454-b8dc-23915f2ba424 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.158846 Aug 09 12:25:31.896297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 214/417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:31 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:32.919384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=6 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:32.925409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:32.926454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:32.929170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:32.937563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:32.938029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:32.938465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:32.939165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:32.939619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:32.940043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:33.070391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:33.078402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-87e60724-9e67-42fe-b009-5454601fbb4c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.161613 Aug 09 12:25:33.078951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 204/418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:32 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:33.908289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-24e84ade-3aa2-4ea2-921f-c7b6d1e59027 req-d6ac867f-6203-44a7-9f09-43fd6f2f2c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839a46e0-41c6-4467-b9fe-a7c9a478c27c", "name": "network-vif-plugged", "status": "completed", "tag": "889c08ff-7822-4d8e-abf6-46dfadd00efd"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:33.913592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:33.914798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:33.925000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-24e84ade-3aa2-4ea2-921f-c7b6d1e59027 req-d6ac867f-6203-44a7-9f09-43fd6f2f2c28 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:33.925709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-24e84ade-3aa2-4ea2-921f-c7b6d1e59027 req-d6ac867f-6203-44a7-9f09-43fd6f2f2c28 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:33.926310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-24e84ade-3aa2-4ea2-921f-c7b6d1e59027 req-d6ac867f-6203-44a7-9f09-43fd6f2f2c28 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:33.939342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-24e84ade-3aa2-4ea2-921f-c7b6d1e59027 req-d6ac867f-6203-44a7-9f09-43fd6f2f2c28 service nova] Creating event network-vif-plugged:889c08ff-7822-4d8e-abf6-46dfadd00efd for instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c on hv-cinder-85236 Aug 09 12:25:33.944966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-24e84ade-3aa2-4ea2-921f-c7b6d1e59027 req-d6ac867f-6203-44a7-9f09-43fd6f2f2c28 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040502 Aug 09 12:25:33.945566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 215/419] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:25:34.104685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:34.105362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:34.113284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:34.113847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:34.114349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:34.115115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:34.115749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:34.116252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:34.306101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:34.314596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-72071bc1-0254-453b-8fba-c783d6cac83f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.213142 Aug 09 12:25:34.315165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 205/420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:34 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:35.335810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:35.336523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:35.343253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:35.343720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:35.344148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:35.344898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:35.345416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:35.345852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:35.477835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:35.489547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61305ad7-4cb3-4327-a58e-95dbc175c958 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.157770 Aug 09 12:25:35.490449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 216/421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:35 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:36.513241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:36.513864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:36.524451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:36.525097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:36.525631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:36.526584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:36.527177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:36.527770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:36.676296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:36.684146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60c2c470-2a36-41c2-a42e-0166202ef43f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1371 microversion: 2.1 time: 0.176350 Aug 09 12:25:36.684765 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 206/422] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:36 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:37.705482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:37.706358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:37.708356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:37.713739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:37.714166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:37.714599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:37.715297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:37.715749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:37.716176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:37.732818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:37.875461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:37.884719 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2aa804b2-a6af-4113-aa92-8d5f96fc1491 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1565 microversion: 2.1 time: 0.183249 Aug 09 12:25:37.895952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 217/423] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:37 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:37.905514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:37.906310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:37.908089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:37.914447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:37.914936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:37.915367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:37.916060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:37.916545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:37.916958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:38.032038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bcc74d46-3da7-4d7b-bc35-abd03c441e05 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130688 Aug 09 12:25:38.040125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 207/424] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 9 12:25:37 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:25:39.055589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:39.055589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:39.057772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-81b0fd49-313c-4d1d-9c5b-077faee6c3d6 req-2c66e3f8-5fea-4417-8db3-d7a06d2f8f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839a46e0-41c6-4467-b9fe-a7c9a478c27c", "tag": "889c08ff-7822-4d8e-abf6-46dfadd00efd"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:39.063761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:39.064934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:39.065373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:39.066248 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:39.067001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:39.067584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:39.069873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-81b0fd49-313c-4d1d-9c5b-077faee6c3d6 req-2c66e3f8-5fea-4417-8db3-d7a06d2f8f1d service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:39.070579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-81b0fd49-313c-4d1d-9c5b-077faee6c3d6 req-2c66e3f8-5fea-4417-8db3-d7a06d2f8f1d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:39.071192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-81b0fd49-313c-4d1d-9c5b-077faee6c3d6 req-2c66e3f8-5fea-4417-8db3-d7a06d2f8f1d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:39.084901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-81b0fd49-313c-4d1d-9c5b-077faee6c3d6 req-2c66e3f8-5fea-4417-8db3-d7a06d2f8f1d service nova] Creating event network-changed:889c08ff-7822-4d8e-abf6-46dfadd00efd for instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c on hv-cinder-85236 Aug 09 12:25:39.090739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-81b0fd49-313c-4d1d-9c5b-077faee6c3d6 req-2c66e3f8-5fea-4417-8db3-d7a06d2f8f1d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036705 Aug 09 12:25:39.091924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 208/425] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:25:39.249527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:39.259756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0ff9d42-5f38-4144-af64-af37eca49dfe tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1594 microversion: 2.1 time: 0.210372 Aug 09 12:25:39.261130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 218/426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:39 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1594 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:25:41.622881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-488cf8b2-e8bc-4198-b406-b29f525c64a0 req-8012423f-0660-4f0f-a1e0-86c1bdc4350f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1dbad9-b1fa-4279-b87e-d19ee96ba798", "tag": "b92622b3-9938-4ed9-bd50-a1d8ff86458f"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:41.632758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-488cf8b2-e8bc-4198-b406-b29f525c64a0 req-8012423f-0660-4f0f-a1e0-86c1bdc4350f service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:41.633232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-488cf8b2-e8bc-4198-b406-b29f525c64a0 req-8012423f-0660-4f0f-a1e0-86c1bdc4350f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:41.633655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-488cf8b2-e8bc-4198-b406-b29f525c64a0 req-8012423f-0660-4f0f-a1e0-86c1bdc4350f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:41.645950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-488cf8b2-e8bc-4198-b406-b29f525c64a0 req-8012423f-0660-4f0f-a1e0-86c1bdc4350f service nova] Creating event network-changed:b92622b3-9938-4ed9-bd50-a1d8ff86458f for instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 on hv-cinder-85236 Aug 09 12:25:41.651989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-488cf8b2-e8bc-4198-b406-b29f525c64a0 req-8012423f-0660-4f0f-a1e0-86c1bdc4350f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033511 Aug 09 12:25:41.653080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 209/427] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:25:42.759484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-863823248"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:42.759907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:42.765896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:42.766374 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:42.766799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:42.767484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:42.768113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:42.768558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:42.898467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.network.security_group_api [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Adding security group 2247e5fd-6e02-4edc-83f9-e3d40a47d168 to port b92622b3-9938-4ed9-bd50-a1d8ff86458f Aug 09 12:25:43.227210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea802cb7-b395-40b0-9fd4-b92cfe71e599 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "POST /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/action" status: 202 len: 0 microversion: 2.1 time: 0.471900 Aug 09 12:25:43.227815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 219/428] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:25:42 2022] POST /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:25:43.237421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:25:43.238126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:25:43.244357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:43.244868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:43.245295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:43.245968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:43.246397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:43.246812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:43.399306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:25:43.407557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1d99a333-61c3-41f3-a785-5ac6dcb5c22c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1759 microversion: 2.1 time: 0.174995 Aug 09 12:25:43.408160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 210/429] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:25:43 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:25:43.673582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-4a30b217-3f95-49ec-bfb7-9d73bce2e5fb req-b616af1d-9f01-418f-a709-74ac3f2d174a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1dbad9-b1fa-4279-b87e-d19ee96ba798", "tag": "b92622b3-9938-4ed9-bd50-a1d8ff86458f"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:25:43.683990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4a30b217-3f95-49ec-bfb7-9d73bce2e5fb req-b616af1d-9f01-418f-a709-74ac3f2d174a service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:25:43.684401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4a30b217-3f95-49ec-bfb7-9d73bce2e5fb req-b616af1d-9f01-418f-a709-74ac3f2d174a service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:25:43.684830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4a30b217-3f95-49ec-bfb7-9d73bce2e5fb req-b616af1d-9f01-418f-a709-74ac3f2d174a service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:25:43.696040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-4a30b217-3f95-49ec-bfb7-9d73bce2e5fb req-b616af1d-9f01-418f-a709-74ac3f2d174a service nova] Creating event network-changed:b92622b3-9938-4ed9-bd50-a1d8ff86458f for instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 on hv-cinder-85236 Aug 09 12:25:43.701278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-4a30b217-3f95-49ec-bfb7-9d73bce2e5fb req-b616af1d-9f01-418f-a709-74ac3f2d174a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034094 Aug 09 12:25:43.701908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 220/430] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:20.081811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=13 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:20.082556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:20.261488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cb1b2e21-e7a6-465c-8ba0-636a97080209 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Action: 'create', calling method: .version_select at 0x7f0e085b9280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-898829135", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9wLVJP6qUB4614kRVf6a4JMYVuBv9ToI7KiRTLejanh2r44bAD4AKZp9jz2p+RiIacPbGTPBdDL9Y0Y+SIy65S+ELvUCtmGa/gB9xlolOvJVaTYrTBwz9k7rNQu5akrw=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:20.281861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-cb1b2e21-e7a6-465c-8ba0-636a97080209 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Getting quotas for project 602ad89c70da4ace9856766be19815a5. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:26:20.285837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-cb1b2e21-e7a6-465c-8ba0-636a97080209 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Getting quotas for user 50fa6727271142eba979bb4562a2b853 and project 602ad89c70da4ace9856766be19815a5. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:26:20.312270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cb1b2e21-e7a6-465c-8ba0-636a97080209 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.235454 Aug 09 12:26:20.312923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 211/431] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:26:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:21.040148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=7 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:21.041686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=15 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:21.047813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:21.048487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:21.056894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:21.057479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:21.057976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:21.058749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:21.059377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:21.059799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:21.088178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-934ceb97-309e-42e3-81e9-cb34d6181ca4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/ips" status: 200 len: 144 microversion: 2.1 time: 0.049173 Aug 09 12:26:21.088774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 221/432] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:26:21 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/ips => generated 144 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:24.257850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad1f82ab-119b-4db6-8900-0186e18d968b"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:24.260132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:24.268545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:24.269054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:24.269468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:24.270171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:24.270759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:24.271179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:24.578395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:24.579017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:24.585532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:24.586012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:24.586436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:24.587325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:24.587819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:24.588341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:24.607109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4e5d33fc-991d-4274-b4b0-6579c5a958ad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353651 Aug 09 12:26:24.607721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 212/433] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:26:24 2022] POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:24.615737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-df082f19-3479-4fe1-90fc-b9658ca01f62 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/ips" status: 200 len: 151 microversion: 2.1 time: 0.042788 Aug 09 12:26:24.616437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 222/434] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:26:24 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:26:26.004803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbf440b1-d03b-420a-bda0-9dbcf6908809"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:26.007292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:26.014624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:26.015100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:26.015564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:26.016353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:26.016828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:26.017288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:26.320862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a82f4226-f2ab-4ede-acac-f936b67b38bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321290 Aug 09 12:26:26.321758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 213/435] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:26:25 2022] POST /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:33.225661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-090a530c-4d34-4cf5-be00-8aad5d225daf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:33.233343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090a530c-4d34-4cf5-be00-8aad5d225daf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:33.233857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090a530c-4d34-4cf5-be00-8aad5d225daf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:33.234314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090a530c-4d34-4cf5-be00-8aad5d225daf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:33.295123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-090a530c-4d34-4cf5-be00-8aad5d225daf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Going to try to stop instance {{(pid=117660) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 12:26:33.342075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-090a530c-4d34-4cf5-be00-8aad5d225daf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.120027 Aug 09 12:26:33.342711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 223/436] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:26:33 2022] POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:26:33.348879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=4 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:33.355481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:33.356412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:33.363814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:33.364478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:33.365060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:33.365799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:33.366272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:33.368471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:33.510691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:33.519232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d8af926e-5e2c-4de9-b0d0-f855783ebb31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.171749 Aug 09 12:26:33.519815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 214/437] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:33 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:34.541184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:34.541990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:34.548877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:34.549354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:34.549777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:34.550460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:34.550904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:34.551320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:34.693496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:34.703866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6364db1-0d55-418b-a9cb-a5842ea50167 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.167064 Aug 09 12:26:34.704464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 224/438] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:34 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:35.731440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:35.732344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:35.743154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:35.743957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:35.744741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:35.745870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:35.746740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:35.747162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:35.884233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:35.892998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b6f6f87b-a5cb-4489-814f-e83dddf3aa81 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.168996 Aug 09 12:26:35.893549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 215/439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:35 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:36.915746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:36.916569 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:36.923605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:36.924089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:36.924563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:36.925253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:36.925700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:36.926122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:37.064653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:37.072905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d56ba181-b413-4c9e-8a1f-402b1abfb55c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.161992 Aug 09 12:26:37.073475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 225/440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:36 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:38.094131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:38.094733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:38.101573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:38.102083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:38.102514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:38.103200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:38.103650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:38.104069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:38.241747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:38.254911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dbd9bee6-d0c8-4009-8ee1-223f64eac2d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.164528 Aug 09 12:26:38.255705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 216/441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:38 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:39.283230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:39.284212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:39.294013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:39.294495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:39.294983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:39.295843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:39.296408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:39.296824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:39.445008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:39.457434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6168ceb3-89d7-43c1-9744-53c6f18d018c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.180911 Aug 09 12:26:39.458265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 226/442] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:39 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:40.479011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:40.479587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:40.486206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:40.486694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:40.487127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:40.487824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:40.488260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:40.488702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:40.622613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:40.631209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-132cd196-59e6-46cf-a46e-8be31a415249 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.156209 Aug 09 12:26:40.631784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 217/443] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:40 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:41.356694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9ec3a1c-9728-4839-832b-ae63dacb88af tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: .version_select at 0x7f0e08463670>, body: {"keypair": {"name": "tempest-keypair-295793974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFUIOuETCjuybobYMltJLyFSLvLTpVMkMgIcOdAZXsizcdChDcKL67+rSFTbu1lAm907R6Vi9ptK8Bvf/udjouAWOvZ/yHWgcGP7e1dW14nrrlClGoZpTgxtvx+Qlmj7g=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:41.371832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-f9ec3a1c-9728-4839-832b-ae63dacb88af tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for project cffa9ae943de44bc8264914e39c80cfa. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:26:41.375964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-f9ec3a1c-9728-4839-832b-ae63dacb88af tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for user c8982b93df5744bbbdeb7a956df06502 and project cffa9ae943de44bc8264914e39c80cfa. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:26:41.401399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9ec3a1c-9728-4839-832b-ae63dacb88af tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048573 Aug 09 12:26:41.401891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 227/444] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:26:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:41.653462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:41.654040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:41.660389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:41.660884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:41.661309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:41.661989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:41.663219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:41.663640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:41.848970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:41.857900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8f16feb5-c9cb-43f3-817d-819ab5c4174a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.208723 Aug 09 12:26:41.858469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 218/445] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:41 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:42.817321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-963900101", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974a024c-61f1-4c3c-ba4e-fa1153d8a5d8"}], "security_groups": [{"name": "tempest-securitygroup--1457100044"}], "key_name": "tempest-keypair-295793974", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:42.879517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:42.880117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:42.889018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:42.889475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:42.890074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:42.890782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:42.891231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:42.891648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:42.946224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] validate_networks() for [('974a024c-61f1-4c3c-ba4e-fa1153d8a5d8', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:26:43.111374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:43.119528 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9194d890-37da-4529-932a-47724c14df11 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.244188 Aug 09 12:26:43.120110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 219/446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:42 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:43.383532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:26:43.383951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:26:43.384396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:26:43.384929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:26:43.385336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:26:43.394890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:43.395372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:43.395826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:43.396580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:43.397027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:43.397438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:43.413930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for project cffa9ae943de44bc8264914e39c80cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:26:43.418727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for user c8982b93df5744bbbdeb7a956df06502 and project cffa9ae943de44bc8264914e39c80cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:26:43.430259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:26:43.432562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:26:43.484620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-176f9872-9efe-4e6d-85d6-7bb30f9eb983 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671351 Aug 09 12:26:43.485669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 228/447] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:26:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:26:43.502589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bcef7ae9-4aa7-4a4b-b003-c2ce6627edbd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:43.503518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bcef7ae9-4aa7-4a4b-b003-c2ce6627edbd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:43.562974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bcef7ae9-4aa7-4a4b-b003-c2ce6627edbd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:43.570842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bcef7ae9-4aa7-4a4b-b003-c2ce6627edbd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1240 microversion: 2.1 time: 0.074453 Aug 09 12:26:43.573262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 220/448] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:43 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:44.141879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:44.142462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:44.149918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:44.150417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:44.150849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:44.151539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:44.152194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:44.152639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:44.286212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:44.294421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-222a4ea9-7cd6-40f9-ae8b-e15b2c92719a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.156744 Aug 09 12:26:44.295009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 229/449] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:44 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:44.592825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:44.593431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:44.602614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:44.603092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:44.603510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:44.604217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:44.604699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:44.605118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:44.710524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:44.718558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ddf0f436-db17-4b3e-aaab-69075ad48c94 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1300 microversion: 2.1 time: 0.130183 Aug 09 12:26:44.719142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 221/450] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:44 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:45.316129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:45.317386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:45.323704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:45.324183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:45.324659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:45.325360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:45.325807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:45.326276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:45.514404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:45.534710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9aecb6d9-8c40-4479-86b2-d1f8e2e84c8b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.223228 Aug 09 12:26:45.535301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 230/451] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:45 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:45.739516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:45.740266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:45.747262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:45.747984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:45.748346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:45.749383 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:45.750345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:45.750751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:45.946518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:45.954853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-476aca94-1f5a-4f8c-9b15-f31422ec7759 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.219224 Aug 09 12:26:45.955452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 222/452] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:45 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:46.175394 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-617c430f-0223-4a2c-a8f5-7793013ad526 req-eb6cbbd0-3105-40f9-b1fd-8aa651c3a283 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566853b6-ba9c-4357-a910-7ddddde30496", "tag": "7d4a9b10-8b5e-49b8-91f6-08422f8bf88d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:46.185907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-617c430f-0223-4a2c-a8f5-7793013ad526 req-eb6cbbd0-3105-40f9-b1fd-8aa651c3a283 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:46.186983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-617c430f-0223-4a2c-a8f5-7793013ad526 req-eb6cbbd0-3105-40f9-b1fd-8aa651c3a283 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:46.187873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-617c430f-0223-4a2c-a8f5-7793013ad526 req-eb6cbbd0-3105-40f9-b1fd-8aa651c3a283 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:46.200765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-617c430f-0223-4a2c-a8f5-7793013ad526 req-eb6cbbd0-3105-40f9-b1fd-8aa651c3a283 service nova] Creating event network-changed:7d4a9b10-8b5e-49b8-91f6-08422f8bf88d for instance 566853b6-ba9c-4357-a910-7ddddde30496 on hv-cinder-85236 Aug 09 12:26:46.206413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-617c430f-0223-4a2c-a8f5-7793013ad526 req-eb6cbbd0-3105-40f9-b1fd-8aa651c3a283 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035976 Aug 09 12:26:46.207184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 231/453] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:46.555513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:46.556148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:46.562585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:46.563070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:46.563501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:46.564240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:46.564721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:46.565139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:46.724624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:46.733666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2dc3665c-a24a-4f3f-93a6-7fadc5a3f5e3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.182170 Aug 09 12:26:46.734447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 223/454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:46 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:46.979065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:46.979827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:46.988039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:46.988721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:46.989224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:46.990066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:46.990620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:46.991139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:47.129708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:47.141123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f5ae6b35-5d74-4900-97b0-e1653a14557d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.167355 Aug 09 12:26:47.141896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 232/455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:46 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:47.310866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1118415844", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898829135", "security_groups": [{"name": "tempest-secgroup-smoke-1174931768"}], "block_device_mapping_v2": [{"uuid": "127acce2-190f-4b63-b431-046f9d93a2f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b924274-f01a-4354-a302-f155f90252c3"}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:47.431214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] validate_networks() for [('6b924274-f01a-4354-a302-f155f90252c3', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:26:47.755960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:47.756577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:47.763022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:47.763503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:47.763933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:47.764745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:47.765207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:47.765671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:47.847125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:26:47.847577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:26:47.848053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:26:47.848620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:26:47.849029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:26:47.858628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:47.859238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:47.859672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:47.860408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:47.860862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:47.861280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:47.878454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Getting quotas for project 602ad89c70da4ace9856766be19815a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:26:47.882590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Getting quotas for user 50fa6727271142eba979bb4562a2b853 and project 602ad89c70da4ace9856766be19815a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:26:47.923560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:47.932407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80e9be88-b0e9-48c2-a4dc-f0ade0a1d9e2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.180457 Aug 09 12:26:47.933186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 233/456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:47 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:47.943832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:26:47.945943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='127acce2-190f-4b63-b431-046f9d93a2f7',volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:26:48.090295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f73cd8c5-4ee6-4366-ac65-550f4d39fe61 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783288 Aug 09 12:26:48.090944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 224/457] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:26:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:26:48.101976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92feeeff-7b17-4c33-9a85-7d7c659aa366 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:48.103161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-92feeeff-7b17-4c33-9a85-7d7c659aa366 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:48.163473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:48.164086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:48.172974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:48.173451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:48.173960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:48.174614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:48.175060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:48.175447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:48.410975 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-92feeeff-7b17-4c33-9a85-7d7c659aa366 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:48.418551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92feeeff-7b17-4c33-9a85-7d7c659aa366 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1094 microversion: 2.1 time: 0.320524 Aug 09 12:26:48.419452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 234/458] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:48 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1094 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:26:48.505885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:48.514177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e5f702f0-9ff7-4965-9c07-b302cc0a9bd1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.355085 Aug 09 12:26:48.514927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 225/459] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:48 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:48.955005 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:48.955609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:48.961977 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:48.962459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:48.962893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:48.963579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:48.964076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:48.964484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:49.109884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:49.118307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d34293de-e9c3-49c0-b760-51071afb73d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1721 microversion: 2.1 time: 0.167951 Aug 09 12:26:49.118885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 235/460] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:48 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:49.443232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:49.444223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:49.454280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:49.454758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:49.455183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:49.455926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:49.456402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:49.456887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:49.517994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:49.526053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d12ad2b-4089-46fd-a101-a6f66b9446ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1144 microversion: 2.1 time: 0.089340 Aug 09 12:26:49.526618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 226/461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:49 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:49.535455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:49.536109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:49.543784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:49.544405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:49.544882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:49.546016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:49.546553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:49.546969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:49.684264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:49.696688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bca22f60-ee6e-43f0-907b-e2ce8ff7b047 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.164908 Aug 09 12:26:49.697464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 236/462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:49 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:50.141295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:50.141901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:50.143766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:50.149759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.150313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.150746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.151481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.151928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.152404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.158577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:50.376272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:50.384362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8107c3ff-8da0-4f4b-b507-220bc798f3a5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1698 microversion: 2.1 time: 0.247762 Aug 09 12:26:50.384942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 227/463] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:50 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1698 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:50.405766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20c2ccb0-7bae-4db4-80d0-33ac51291ff3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:50.412175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20c2ccb0-7bae-4db4-80d0-33ac51291ff3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.412717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20c2ccb0-7bae-4db4-80d0-33ac51291ff3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.413151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20c2ccb0-7bae-4db4-80d0-33ac51291ff3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.436201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20c2ccb0-7bae-4db4-80d0-33ac51291ff3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Going to try to start instance {{(pid=117660) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 12:26:50.483224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20c2ccb0-7bae-4db4-80d0-33ac51291ff3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.081433 Aug 09 12:26:50.483876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 237/464] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:26:50 2022] POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:26:50.492053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:50.492686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:50.499069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.500522 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.500960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.501645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.502100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.502518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.548292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:50.549025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:50.555770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.556285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.556924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.557717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.558206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.558655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.669993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:50.679176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd0627c4-b254-4751-a550-4246c34d1808 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1192 microversion: 2.1 time: 0.135514 Aug 09 12:26:50.679702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 238/465] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:50 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1192 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:50.709274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:50.725601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4c7c334a-57f1-4633-9943-a04deed97eac tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1707 microversion: 2.1 time: 0.237187 Aug 09 12:26:50.727526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 228/466] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:50 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1707 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:50.732242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:50.733250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:50.739698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.740475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.741081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.741968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:50.742641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:50.743225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:50.766572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:51.052171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:51.061822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-092c229f-abd8-475c-afaa-8bce5b54c46d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.333249 Aug 09 12:26:51.062650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 239/467] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:50 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:51.705870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:51.706752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:51.720715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:51.722659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:51.726239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:51.727212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:51.727700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:51.728198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:51.753155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:51.757478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:51.759614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:51.765730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:51.766430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:51.766907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:51.767623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:51.768079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:51.768533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:51.951766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:51.963445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3f044aa8-fce5-429e-a383-2d201973fa43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1278 microversion: 2.1 time: 0.262245 Aug 09 12:26:51.965033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 229/468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:51 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1278 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:51.983506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:51.991544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0735847f-1564-403f-8257-461201d8b4e4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1707 microversion: 2.1 time: 0.247813 Aug 09 12:26:51.992112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 240/469] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:51 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1707 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:26:52.084035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:52.084897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:52.091093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:52.091826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:52.092265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:52.093085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:52.093711 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:52.094170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:52.239299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:52.251280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e466e230-5841-400f-bcdb-2bffbb62ea12 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.170928 Aug 09 12:26:52.252165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 230/470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:52 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:52.338384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-8778a73b-578a-4f84-9265-513bafc22fa9 req-fc968673-be4c-491c-9ce8-505fed80473e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c88f62f-d964-413d-a4be-e4f7341cabe9", "tag": "bc8f15c0-f198-4c6e-a2e3-e05889e916b2"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:52.348984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-8778a73b-578a-4f84-9265-513bafc22fa9 req-fc968673-be4c-491c-9ce8-505fed80473e service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:52.349431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-8778a73b-578a-4f84-9265-513bafc22fa9 req-fc968673-be4c-491c-9ce8-505fed80473e service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:52.349857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-8778a73b-578a-4f84-9265-513bafc22fa9 req-fc968673-be4c-491c-9ce8-505fed80473e service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:52.363296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-8778a73b-578a-4f84-9265-513bafc22fa9 req-fc968673-be4c-491c-9ce8-505fed80473e service nova] Creating event network-changed:bc8f15c0-f198-4c6e-a2e3-e05889e916b2 for instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 on hv-cinder-85236 Aug 09 12:26:52.368321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-8778a73b-578a-4f84-9265-513bafc22fa9 req-fc968673-be4c-491c-9ce8-505fed80473e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034549 Aug 09 12:26:52.368929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 241/471] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:52.990331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:52.991314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:53.001458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:53.001936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:53.002365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:53.003044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:53.003491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:53.003901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:53.014107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:53.014990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:53.021759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:53.022236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:53.022661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:53.023341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:53.023786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:53.024199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:53.206405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:53.210816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:53.214317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-159202b0-e57a-48d8-8289-b8267693e03a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.230613 Aug 09 12:26:53.214929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 231/472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:52 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:53.219218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2d85fa18-757f-4778-bc87-61e3e2054666 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1707 microversion: 2.1 time: 0.209355 Aug 09 12:26:53.219812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 242/473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:53 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1707 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:53.275445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:53.276471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:53.286414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:53.287207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:53.287927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:53.289122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:53.289871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:53.290619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:53.437484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:53.445097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-24c4796b-5515-4754-9efa-7a9a236d2f22 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.176038 Aug 09 12:26:53.445664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 232/474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:53 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:53.693306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-93b62b1b-f73f-4372-8ba4-32ed1e67aec3 req-62a1d260-2868-42f5-b4c1-3d14d2957785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566853b6-ba9c-4357-a910-7ddddde30496", "name": "network-vif-plugged", "status": "completed", "tag": "7d4a9b10-8b5e-49b8-91f6-08422f8bf88d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:53.698292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:53.704637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-93b62b1b-f73f-4372-8ba4-32ed1e67aec3 req-62a1d260-2868-42f5-b4c1-3d14d2957785 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:53.705111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-93b62b1b-f73f-4372-8ba4-32ed1e67aec3 req-62a1d260-2868-42f5-b4c1-3d14d2957785 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:53.705530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-93b62b1b-f73f-4372-8ba4-32ed1e67aec3 req-62a1d260-2868-42f5-b4c1-3d14d2957785 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:53.718933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-93b62b1b-f73f-4372-8ba4-32ed1e67aec3 req-62a1d260-2868-42f5-b4c1-3d14d2957785 service nova] Creating event network-vif-plugged:7d4a9b10-8b5e-49b8-91f6-08422f8bf88d for instance 566853b6-ba9c-4357-a910-7ddddde30496 on hv-cinder-85236 Aug 09 12:26:53.731180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-93b62b1b-f73f-4372-8ba4-32ed1e67aec3 req-62a1d260-2868-42f5-b4c1-3d14d2957785 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041695 Aug 09 12:26:53.731789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 243/475] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:54.239958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:54.240909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:54.247852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:54.249105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:54.252638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:54.253440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:54.254160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:54.255295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:54.256043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:54.256768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:54.259627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:54.260434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:54.261212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:54.262349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:54.263107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:54.263812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:54.455152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:54.460818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:54.466350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-288f3427-6526-442f-9fb1-623731669d9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.232968 Aug 09 12:26:54.467052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 233/476] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:54 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:54.471436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6a81cfb-5cd0-4843-b3f6-45a61cc2208a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1711 microversion: 2.1 time: 0.230796 Aug 09 12:26:54.471905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:54.472537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:54.479008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:54.479596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:54.480022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 244/477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:54 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1711 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:54.480206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:54.480968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:54.481452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:54.481867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:54.616788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:54.625083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cabdfa2f-e68b-4e98-9531-a026cfb57e80 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.156602 Aug 09 12:26:54.625668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 234/478] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:54 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:55.490870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:55.491932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:55.502888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:55.503703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:55.504456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:55.505607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:55.506367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:55.507073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:55.645099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:55.645651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:55.652463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:55.652943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:55.653367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:55.654059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:55.654501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:55.654912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:55.792310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:55.800189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b51b78ca-5dab-47fe-a81a-c19f5fbe4b17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.316135 Aug 09 12:26:55.800910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 245/479] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:55 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:55.867685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:55.877116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3c834b9e-4acd-479b-9c83-82bf0d20f74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.236017 Aug 09 12:26:55.877688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 235/480] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:55 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:56.825782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:56.826938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:56.837329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:56.838121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:56.838828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:56.839947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:56.840742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:56.841430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:56.897677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:56.898311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:56.905105 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:56.905589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:56.906247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:56.906943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:56.907390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:56.907824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:57.025852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:57.034285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f889ddff-5ef3-4f6a-ac77-bce0edb2f438 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.215002 Aug 09 12:26:57.034846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 246/481] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:56 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:57.071825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:57.079625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-761aa538-5dbc-404b-a5e1-21b16c85e341 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1366 microversion: 2.1 time: 0.185782 Aug 09 12:26:57.080197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 236/482] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:56 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:58.059233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:58.060204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:58.067849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:58.068370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:58.068834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:58.069534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:58.069990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:58.070410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:58.100645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:58.101220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:58.103103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:58.103755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=8 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:58.110148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:58.110625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:58.111049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:58.111747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:58.112179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:58.112615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:58.255608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:58.263620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee80c955-8dd2-4fc5-b31b-c186a216bef0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.210925 Aug 09 12:26:58.264198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 247/483] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:58 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:58.285322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:58.293098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-654b1a65-2202-4db5-964c-3cde132b1abb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1556 microversion: 2.1 time: 0.196352 Aug 09 12:26:58.293668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 237/484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:58 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1556 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:58.313966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:58.314454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:58.320947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:58.321431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:58.321857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:58.322543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:58.322993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:58.323413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:58.402102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ebd69ee-c45f-4321-90ca-f5fa6d6849ca tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092253 Aug 09 12:26:58.402697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 248/485] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 9 12:26:58 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:59.285064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:59.285746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:59.292831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:59.293407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:59.293866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:59.294564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:59.295016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:59.295443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:59.671577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-d84f74d5-48c4-42a6-8c37-c3d728b9aa9b req-51b5ede5-45e1-4e6d-91f6-8eef6f89933d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "566853b6-ba9c-4357-a910-7ddddde30496", "tag": "7d4a9b10-8b5e-49b8-91f6-08422f8bf88d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:26:59.676915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=12 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:59.683504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d84f74d5-48c4-42a6-8c37-c3d728b9aa9b req-51b5ede5-45e1-4e6d-91f6-8eef6f89933d service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:59.684073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d84f74d5-48c4-42a6-8c37-c3d728b9aa9b req-51b5ede5-45e1-4e6d-91f6-8eef6f89933d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:59.684595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d84f74d5-48c4-42a6-8c37-c3d728b9aa9b req-51b5ede5-45e1-4e6d-91f6-8eef6f89933d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:59.692919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:26:59.696953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-d84f74d5-48c4-42a6-8c37-c3d728b9aa9b req-51b5ede5-45e1-4e6d-91f6-8eef6f89933d service nova] Creating event network-changed:7d4a9b10-8b5e-49b8-91f6-08422f8bf88d for instance 566853b6-ba9c-4357-a910-7ddddde30496 on hv-cinder-85236 Aug 09 12:26:59.701211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c7f73d99-817b-43e7-883d-e27314532aa6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.419237 Aug 09 12:26:59.701804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 238/486] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:26:59 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:26:59.702362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-d84f74d5-48c4-42a6-8c37-c3d728b9aa9b req-51b5ede5-45e1-4e6d-91f6-8eef6f89933d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034513 Aug 09 12:26:59.703346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 249/487] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:26:59.872304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:26:59.872986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:26:59.880360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:59.883418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:59.883418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:59.883418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:26:59.883418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:26:59.883781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:26:59.910178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-924b2555-af22-4d1f-8463-d3316e2c4b0a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/ips" status: 200 len: 151 microversion: 2.20 time: 0.042485 Aug 09 12:26:59.911031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 239/488] 10.222.0.60 () {60 vars in 1289 bytes} [Tue Aug 9 12:26:59 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:27:00.725068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:00.725949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:00.733481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:00.734118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:00.734865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:00.735409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:00.735863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:00.736287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:00.881325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:00.890545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b96eca54-b2f1-45a8-8a1d-d730bbdfa46c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.170055 Aug 09 12:27:00.891212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 250/489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:00 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:01.912025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:01.912655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:01.919610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:01.920097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:01.920583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:01.921308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:01.921960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:01.922175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:02.056800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:02.057913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:02.058532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:02.065187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:02.065371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4750c2ae-fee0-45da-8218-d45821ec2a69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.157600 Aug 09 12:27:02.065860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:02.065997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 240/490] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:01 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:02.066367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:02.067127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:02.067647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:02.068135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:02.090820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lazy-loading 'flavor' on Instance uuid 1af3fcd4-07fc-4de6-8634-f028e6c4f369 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:27:02.303206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad4711d2-f46d-46c1-8ff5-0de746284adf tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/action" status: 202 len: 0 microversion: 2.20 time: 0.249228 Aug 09 12:27:02.303821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 251/491] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Aug 9 12:27:02 2022] POST /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:27:02.312435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:02.312984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:02.319507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:02.320090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:02.320570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:02.321415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:02.321856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:02.322415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:02.457580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:02.469642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:02.471917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:02.473661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d57dd2c8-afc3-4eec-9f43-afd82893034c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.165096 Aug 09 12:27:02.474379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 241/492] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:02 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:03.091670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:03.092790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:03.103448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:03.104254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:03.105022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:03.106161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:03.106913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:03.107614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:03.244941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:03.252924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5049293-e97e-4a91-9c04-a2a45565b469 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.168517 Aug 09 12:27:03.253524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 252/493] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:03 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:03.501686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:03.502253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:03.509147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:03.509628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:03.510060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:03.510746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:03.511199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:03.511618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:03.649821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:03.658245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:03.659722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:03.660936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f05485ad-0a77-4afa-9f38-106b56b25e08 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.166028 Aug 09 12:27:03.661527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 242/494] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:03 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:04.275648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:04.276303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:04.284004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:04.284513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:04.284942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:04.285631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:04.286081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:04.286503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:04.424725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:04.432628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c3bfb06-4323-41d3-ba79-34c4c23bc4a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.162161 Aug 09 12:27:04.433362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 253/495] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:04 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:04.685050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:04.685597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:04.692822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:04.693298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:04.693724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:04.694406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:04.694852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:04.695231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:04.828572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:04.836811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:04.838295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:04.839443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2d466d1b-0ae9-448b-8939-44d9be3a2571 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.158484 Aug 09 12:27:04.840068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 243/496] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:04 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:05.456732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:05.457402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:05.464409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:05.464944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:05.465431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:05.466579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:05.467080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:05.467551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:05.611123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:05.619185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61e933cd-c0e4-4bcd-84fc-f9477865e4e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.168093 Aug 09 12:27:05.619657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 254/497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:05 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:05.863461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:05.864029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:05.870874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:05.871286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:05.871717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:05.872439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:05.872895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:05.873314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:05.877025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:06.014112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:06.022960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:06.024459 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:06.025612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7be1c303-90a9-48a8-967f-f4f22471f89b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.166684 Aug 09 12:27:06.026206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 244/498] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:05 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:06.102242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-64022562-f627-4952-a51e-b5eb2f227065 req-29f89542-b702-42eb-9acb-bc5dcb19c113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c88f62f-d964-413d-a4be-e4f7341cabe9", "name": "network-vif-plugged", "status": "completed", "tag": "bc8f15c0-f198-4c6e-a2e3-e05889e916b2"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:06.112949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-64022562-f627-4952-a51e-b5eb2f227065 req-29f89542-b702-42eb-9acb-bc5dcb19c113 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:06.113429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-64022562-f627-4952-a51e-b5eb2f227065 req-29f89542-b702-42eb-9acb-bc5dcb19c113 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:06.113868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-64022562-f627-4952-a51e-b5eb2f227065 req-29f89542-b702-42eb-9acb-bc5dcb19c113 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:06.128130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-64022562-f627-4952-a51e-b5eb2f227065 req-29f89542-b702-42eb-9acb-bc5dcb19c113 service nova] Creating event network-vif-plugged:bc8f15c0-f198-4c6e-a2e3-e05889e916b2 for instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 on hv-cinder-85236 Aug 09 12:27:06.133217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-64022562-f627-4952-a51e-b5eb2f227065 req-29f89542-b702-42eb-9acb-bc5dcb19c113 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034836 Aug 09 12:27:06.133800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 255/499] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:27:06.641885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:06.642479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:06.648544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:06.649112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:06.649546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:06.650242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:06.650726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:06.651144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:06.786920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:06.794875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-534311d2-f162-4db3-9caf-0cbd1b4f88b6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.157221 Aug 09 12:27:06.795450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 245/500] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:06 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:07.053528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:07.054644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:07.064181 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:07.064687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:07.065116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:07.065765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:07.066242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:07.066661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:07.205117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:07.213262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:07.214745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:07.215895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2e179377-627e-4c7d-8ee8-6ac41c3fd2f4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.169762 Aug 09 12:27:07.216475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 256/501] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:07 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:07.818102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:07.818840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:07.827157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:07.827784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:07.828800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:07.829489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:07.829941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:07.830357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:07.967514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:07.976206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-595d2f74-a1b2-4328-b36b-a5a925206db3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.163778 Aug 09 12:27:07.976819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 246/502] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:07 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:08.242458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:08.243122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:08.251735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:08.252219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:08.252684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:08.253392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:08.253840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:08.254263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:08.258348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:08.405727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:08.414630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:08.416129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:08.417323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08dbfc60-78d1-4f87-ad64-89bc550c4740 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.181262 Aug 09 12:27:08.417888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 257/503] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:08 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:09.002406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:09.003089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:09.010625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:09.011183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:09.011685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:09.012525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:09.013046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:09.013532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:09.162944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:09.173882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c76ce39-f62e-43e5-9ed2-8fa59edafbbc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1266 microversion: 2.1 time: 0.177909 Aug 09 12:27:09.174704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 247/504] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:08 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:09.441499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:09.442023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:09.448122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:09.448608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:09.449037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:09.449723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:09.450171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:09.450621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:09.586928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:09.595611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:09.597144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:09.598312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fcd04e5d-53f9-4f41-9d11-b162e0e38843 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.161246 Aug 09 12:27:09.598867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 258/505] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:09 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:10.199393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:10.200021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:10.207205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:10.207696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:10.208229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:10.208961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:10.209408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:10.209816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:10.351637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:10.360045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-405de4ee-32ba-4612-b244-8936069f2cea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1454 microversion: 2.1 time: 0.164604 Aug 09 12:27:10.360748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 248/506] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:10 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:10.381208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:10.381829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:10.387674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:10.388145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:10.388588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:10.389271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:10.390131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:10.390278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:10.522117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:10.530330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-66bc08b3-8745-43c9-b3aa-b53abce96ae5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1454 microversion: 2.1 time: 0.152952 Aug 09 12:27:10.531018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 259/507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:10 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:10.621210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:10.622638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:10.629440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:10.629957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:10.630394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:10.631128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:10.631579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:10.632198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:10.795696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:10.805240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:10.807405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:10.808919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0f7b10b2-8c35-4422-a574-a12f866d0a8b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.191838 Aug 09 12:27:10.810354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 249/508] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:10 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:11.834260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:11.834879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:11.841427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:11.842580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:11.843016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:11.843695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:11.844338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:11.845925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:11.981535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:11.989580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:11.991072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:11.992217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bb8d67fb-4a84-4c62-80b5-8b14c2057aec tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.162121 Aug 09 12:27:12.004431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 260/509] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:11 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:12.235445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-4bb0de72-613d-4ad2-b0d6-e34d2d777047 req-a9f5c05b-4574-4aee-83ae-f86f6a2d966b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c88f62f-d964-413d-a4be-e4f7341cabe9", "tag": "bc8f15c0-f198-4c6e-a2e3-e05889e916b2"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:12.245096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4bb0de72-613d-4ad2-b0d6-e34d2d777047 req-a9f5c05b-4574-4aee-83ae-f86f6a2d966b service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:12.245571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4bb0de72-613d-4ad2-b0d6-e34d2d777047 req-a9f5c05b-4574-4aee-83ae-f86f6a2d966b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:12.245989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4bb0de72-613d-4ad2-b0d6-e34d2d777047 req-a9f5c05b-4574-4aee-83ae-f86f6a2d966b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:12.258362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-4bb0de72-613d-4ad2-b0d6-e34d2d777047 req-a9f5c05b-4574-4aee-83ae-f86f6a2d966b service nova] Creating event network-changed:bc8f15c0-f198-4c6e-a2e3-e05889e916b2 for instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 on hv-cinder-85236 Aug 09 12:27:12.263459 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-4bb0de72-613d-4ad2-b0d6-e34d2d777047 req-a9f5c05b-4574-4aee-83ae-f86f6a2d966b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Aug 09 12:27:12.264045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 250/510] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:27:13.015546 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:13.016132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:13.022243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:13.022729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:13.023157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:13.023845 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:13.024293 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:13.024737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:13.165837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:13.174636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:13.176665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:13.177849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8021ded7-0c6b-4e27-91b8-3e1c9817920f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.166493 Aug 09 12:27:13.178385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 261/511] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:13 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:14.202701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:14.203432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:14.210172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:14.210649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:14.211069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:14.211748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:14.212195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:14.212643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:14.364276 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:14.375935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:14.377432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:14.378580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-49e8d010-e22f-4b94-bd76-ed4b9dd77e47 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.180789 Aug 09 12:27:14.379136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 251/512] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:14 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:15.410991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:15.411654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:15.418715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:15.419264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:15.419758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:15.420544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:15.421046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:15.421517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:15.567935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:15.576081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:15.577606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:15.578753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8fe2710f-2d07-4c50-9243-434c93e3bd89 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.172516 Aug 09 12:27:15.579554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 262/513] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:15 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:16.612731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:16.613766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:16.625177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:16.625980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:16.626599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:16.627457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:16.627905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:16.628319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:16.763086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:16.772495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:16.774097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:16.775284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-654e27d9-8bea-4154-84a2-ef314d108a45 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.169687 Aug 09 12:27:16.775843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 252/514] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:16 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:17.802744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:17.803705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:17.814455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:17.815260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:17.815967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:17.817183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:17.817908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:17.818664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:17.963489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:17.972075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:17.973602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:17.974752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4bf6b9a1-fb00-4106-b048-8971de0607a1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.179332 Aug 09 12:27:17.975302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 263/515] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:17 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:19.002113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:19.002969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:19.013192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:19.014079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:19.014754 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:19.015796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:19.016495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:19.017230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:19.152404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:19.165014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:19.167256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:19.168990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b68ff548-de10-4122-ab43-ea216ab3fbc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1744 microversion: 2.20 time: 0.173467 Aug 09 12:27:19.169731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 253/516] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:18 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:20.197300 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:20.198176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:20.208766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:20.209610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:20.210305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:20.211437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:20.212187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:20.212928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:20.359806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:20.368004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:20.369536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:20.370696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd7834ac-e586-48d5-9806-60c32472e98f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1744 microversion: 2.20 time: 0.180123 Aug 09 12:27:20.371258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 264/517] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:20 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1744 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:21.398087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:21.398735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:21.402409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:21.409395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:21.410084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:21.410715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:21.411695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:21.412340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:21.412993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:21.556041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:21.564205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:21.565710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:21.566900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2e579090-4aca-492a-ab75-72e52298ea6d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1744 microversion: 2.20 time: 0.175186 Aug 09 12:27:21.567471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 254/518] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:21 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:22.595594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:22.596672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:22.598744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=50 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:22.604148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:22.604668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:22.605101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:22.605806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:22.606258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:22.606674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:22.741649 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:22.750090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:22.751864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:22.753079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0cd1f16-4e72-4c46-9c6c-14a3b4b926dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1744 microversion: 2.20 time: 0.161664 Aug 09 12:27:22.753627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 265/519] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:22 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:23.780476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:23.781465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:23.792525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:23.793358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:23.794077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:23.795207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:23.795953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:23.796660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:23.946792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:23.955127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:23.956566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:23.957725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6c58cbdc-624a-469e-bca8-d6f0829b054f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1744 microversion: 2.20 time: 0.183804 Aug 09 12:27:23.958268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 255/520] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:23 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:24.178824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-2b3adaf2-9682-42d6-9f97-d91acb7fa2f3 req-7f9bebf7-188a-4f19-8989-9fcf131c7355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af3fcd4-07fc-4de6-8634-f028e6c4f369", "name": "network-vif-plugged", "status": "completed", "tag": "2fce29dc-f113-418f-9748-cb44df959451"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:24.190524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2b3adaf2-9682-42d6-9f97-d91acb7fa2f3 req-7f9bebf7-188a-4f19-8989-9fcf131c7355 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:24.191104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2b3adaf2-9682-42d6-9f97-d91acb7fa2f3 req-7f9bebf7-188a-4f19-8989-9fcf131c7355 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:24.191558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2b3adaf2-9682-42d6-9f97-d91acb7fa2f3 req-7f9bebf7-188a-4f19-8989-9fcf131c7355 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:24.203663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-2b3adaf2-9682-42d6-9f97-d91acb7fa2f3 req-7f9bebf7-188a-4f19-8989-9fcf131c7355 service nova] Creating event network-vif-plugged:2fce29dc-f113-418f-9748-cb44df959451 for instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 on hv-cinder-85236 Aug 09 12:27:24.209432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-2b3adaf2-9682-42d6-9f97-d91acb7fa2f3 req-7f9bebf7-188a-4f19-8989-9fcf131c7355 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034407 Aug 09 12:27:24.210042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 266/521] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:27:24.969863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:24.975529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:24.983483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:24.983865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:24.984549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:24.985452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:24.985901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:24.986205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:24.986338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:24.988197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:24.995478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:24.996068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:24.996625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:24.997329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:24.997961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:24.998389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:25.072219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e76925c-511e-4b3a-b7b1-1aac0aff158c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "POST /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/action" status: 202 len: 0 microversion: 2.1 time: 0.108108 Aug 09 12:27:25.075816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 256/522] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:27:24 2022] POST /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:27:25.081648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:25.082351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:25.092994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:25.093494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:25.093928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:25.094645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:25.095084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:25.095498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:25.173481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:25.183712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:25.185514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:25.186576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca784150-eff8-45e2-ae64-6d708134c4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.205590 Aug 09 12:27:25.187385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 267/523] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:24 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:25.273492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:25.282189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a410615e-b34f-4890-bf10-7152add6b8d6 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1751 microversion: 2.1 time: 0.204909 Aug 09 12:27:25.282769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 257/524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:25 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:26.211302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:26.213520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:26.220932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:26.222208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:26.223336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:26.224586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:26.225348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:26.225990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:26.306945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:26.308336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:26.321543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:26.322338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:26.322979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:26.323891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:26.324354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:26.324803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:26.490845 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:26.500063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:26.501932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:26.504084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7fb9ce03-69f9-41c1-89bc-a92febfa87b4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.297535 Aug 09 12:27:26.505996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 268/525] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:26 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:26.558696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:26.567441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-755e7f34-ec60-43cf-83d4-62731b341e78 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.265259 Aug 09 12:27:26.568287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 258/526] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:26 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:27.549690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:27.551386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:27.558038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:27.559144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:27.560213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:27.561228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:27.561894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:27.562505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:27.589214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:27.590628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:27.598511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:27.599287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:27.599978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:27.601008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:27.601721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:27.602351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:27.777436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:27.789581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:27.791208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:27.792500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16cb6492-3ad4-442d-89e9-92e838711a6b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.247412 Aug 09 12:27:27.808896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 269/527] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:27 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:27.831639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:27.843629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bc22e413-687a-449e-8cc2-2b5c3fafe725 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.258197 Aug 09 12:27:27.844627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 259/528] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:27 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:27:28.819688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:28.821009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:28.827116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:28.828014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:28.828685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:28.829591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:28.830352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:28.831054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:28.866207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:28.867091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:28.873982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:28.875511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:28.876296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:28.877375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:28.878032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:28.878645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:28.911349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:29.050913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:29.059635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:29.061619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:29.062986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6a9692d-4152-40ef-94e3-ca73c4ee838f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.247718 Aug 09 12:27:29.078863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 270/529] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:28 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:29.098775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:29.108737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2a4442b9-1744-4144-984e-8f84037942bc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.247366 Aug 09 12:27:29.109620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 260/530] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:28 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:30.086391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:30.087637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:30.101817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:30.102610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:30.103051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:30.103750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:30.104201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:30.104635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:30.131346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:30.132585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:30.144820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:30.145312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:30.149053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:30.149866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:30.150831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:30.151493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:30.310741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:30.320457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:30.322470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:30.323826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8249a048-07b6-4d8d-aadc-050a970a05e5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.241496 Aug 09 12:27:30.324987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 271/531] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:30 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:30.373157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:30.382443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7fb53698-651c-4263-83a4-f777e5cfc97b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.255461 Aug 09 12:27:30.383192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 261/532] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:30 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:31.348095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:31.348883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:31.355355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:31.355861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:31.356285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:31.357054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:31.357504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:31.362473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:31.403203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:31.404663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:31.411601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:31.412092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:31.412576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:31.413484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:31.413947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:31.414629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:31.558962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:31.569385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:31.571250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:31.572451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cbccbc49-a20a-4f76-ae62-44188d729de1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.228848 Aug 09 12:27:31.573210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 272/533] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:31 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:31.609150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:31.618631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-db0b20df-f693-4b96-9a15-5cc4f4b3be7e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.219248 Aug 09 12:27:31.619211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 262/534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:31 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:27:32.597525 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:32.598867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:32.605624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:32.606393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:32.606864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:32.607561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:32.608008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:32.608484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:32.641427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:32.642745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:32.649702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:32.650184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:32.650609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:32.651282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:32.651726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:32.653344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:32.828002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:32.844515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:32.847077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:32.848658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bca85c34-797b-470d-9e83-a8d76fc80df5 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.255791 Aug 09 12:27:32.864412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 273/535] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:32 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:32.864818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:32.864818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b41c2b43-2f2b-447c-b5c2-1a1bb058611f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.227075 Aug 09 12:27:32.865358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 263/536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:32 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:33.881620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:33.882630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:33.893813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:33.894397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:33.895025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:33.895747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:33.896267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:33.899965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:33.901565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:33.902660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:33.912867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:33.914136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:33.915147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:33.915965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:33.916883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:33.917740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:33.924007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:34.119596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:34.144639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:34.144639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:34.144639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c1673309-ed8e-4252-8981-a7d729c7c557 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.266036 Aug 09 12:27:34.145062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 274/537] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:33 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:34.175331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:34.183760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-955ceefa-1e36-40d6-9510-0fc7b84ee51b tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.291494 Aug 09 12:27:34.196860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 264/538] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:33 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:35.166474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:35.167205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:35.173491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:35.174131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:35.174587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:35.175255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:35.175694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:35.176101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:35.206670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:35.207274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:35.215028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:35.215556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:35.215981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:35.216715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:35.217160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:35.217572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:35.361902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:35.370082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:35.371645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:35.372838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-04466656-4d57-432f-a941-0be791024bf2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1739 microversion: 2.20 time: 0.210371 Aug 09 12:27:35.373596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 275/539] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:35 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:35.405648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:35.414096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f66b7b44-c16d-404e-becf-0db1e6bd1a22 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.211488 Aug 09 12:27:35.414675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 265/540] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:35 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:36.396430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:36.397068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:36.403483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:36.403961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:36.404403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:36.405102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:36.405557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:36.405960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:36.435295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:36.435902 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:36.443044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:36.443532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:36.444000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:36.444730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:36.445357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:36.445787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:36.593438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:36.602739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:36.605133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:36.606354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-57c8a30a-50c8-420a-a8c1-c78e0bb9d997 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1721 microversion: 2.20 time: 0.214039 Aug 09 12:27:36.607254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 276/541] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:36 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:36.632158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:36.641582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-873ac7bd-f422-4cce-b5ef-f8e073887648 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.210176 Aug 09 12:27:36.642400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 266/542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:36 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:36.943378 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7309348-8506-497d-877c-70f7777e5a16"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:36.945835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:36.951932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:36.952431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:36.952879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:36.953571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:36.954024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:36.954443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:37.634349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:37.635290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:37.645833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:37.646708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:37.647433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:37.648690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:37.649461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:37.650176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:37.785365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:37.793529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:37.794999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:37.796140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5378a8d5-f1fe-439e-bc81-4569480c1427 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1721 microversion: 2.20 time: 0.168719 Aug 09 12:27:37.796733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 267/543] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:37 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:37.801148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:37.801738 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:37.807309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:37.807788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:37.808213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:37.808917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:37.809338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:37.809753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:37.951508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:37.961893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c36f80e-f83f-4358-95b3-e2d2ce6ae71c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.164220 Aug 09 12:27:37.962472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 268/544] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:37 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:38.822879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:38.823683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:38.831226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:38.831825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:38.832394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:38.833593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:38.834162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:38.834679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:38.979563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:38.987887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:38.989453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:38.990623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-773b1b7f-f951-4e03-a599-5496decae383 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1721 microversion: 2.20 time: 0.173365 Aug 09 12:27:38.991191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 269/545] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:38 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:27:39.010972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:39.011601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:39.017829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:39.018312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:39.018742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:39.019450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:39.019890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:39.020328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:39.042063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0dbccf1f-8234-4ebf-b8d8-7bcab9820a95 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.214462 Aug 09 12:27:39.048557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 277/546] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:27:36 2022] POST /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments => generated 194 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:27:39.170125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:39.178175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4cb621f2-6c04-4924-8957-a1af6f0398f1 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.170982 Aug 09 12:27:39.178735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 270/547] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:38 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:40.015205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:40.015908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:40.022524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.023006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.023441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.024128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.024617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.025041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.162764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:40.171639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:40.173150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:40.174729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27a1a401-a098-4cc6-95f4-2facd61daa86 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1664 microversion: 2.20 time: 0.164434 Aug 09 12:27:40.175275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 278/548] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:40 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:40.196922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e0680e4-0a6a-4c2d-9984-d71fb752724d"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:40.198477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:40.199077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:40.199418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:40.205047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.205517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.205937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.206477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.206624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.206958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.207072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.207468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.207566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.208172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.208645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.209055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.356008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:40.364754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ea75a43-a8b7-4897-8c09-d9b346237450 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.169826 Aug 09 12:27:40.365294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 279/549] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:40 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:27:40.520866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-210a4c9f-76a3-4f1c-a3ec-3dfd18be86e0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327935 Aug 09 12:27:40.521537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 271/550] 10.222.0.60 () {62 vars in 1364 bytes} [Tue Aug 9 12:27:40 2022] POST /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:27:40.533145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-ec7e32cd-dc54-493d-a175-17322024d837 req-88a68f69-467f-48aa-a049-e627ca6c5c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af3fcd4-07fc-4de6-8634-f028e6c4f369", "name": "network-vif-unplugged", "status": "completed", "tag": "2fce29dc-f113-418f-9748-cb44df959451"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:40.545417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ec7e32cd-dc54-493d-a175-17322024d837 req-88a68f69-467f-48aa-a049-e627ca6c5c83 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.545924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ec7e32cd-dc54-493d-a175-17322024d837 req-88a68f69-467f-48aa-a049-e627ca6c5c83 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.546350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ec7e32cd-dc54-493d-a175-17322024d837 req-88a68f69-467f-48aa-a049-e627ca6c5c83 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.559075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.compute.server_external_events [req-ec7e32cd-dc54-493d-a175-17322024d837 req-88a68f69-467f-48aa-a049-e627ca6c5c83 service nova] Unable to find a host for instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369. Dropping event network-vif-unplugged {{(pid=117660) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 12:27:40.560086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-ec7e32cd-dc54-493d-a175-17322024d837 req-88a68f69-467f-48aa-a049-e627ca6c5c83 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031437 Aug 09 12:27:40.560884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 280/551] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 12:27:40.647330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:40.647927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:40.655130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.655651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.656054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.656785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.657236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.657686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.747525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117661) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 12:27:40.824122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2e6197dc-4adf-4c81-abaa-6bf2c632202b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/action" status: 202 len: 0 microversion: 2.20 time: 0.180775 Aug 09 12:27:40.825136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 272/552] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Aug 9 12:27:40 2022] POST /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:27:40.833114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:40.833721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:40.839871 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.840350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.840814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.841509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:40.842048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:40.842552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:40.981764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:40.990202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:40.991674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:40.992842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e078befe-014d-4cf8-8e01-90c0dfa9b354 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1750 microversion: 2.20 time: 0.163625 Aug 09 12:27:40.993392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 281/553] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:40 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:41.386386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:41.387102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:41.394010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:41.394567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:41.395185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:41.396042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:41.396662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:41.397279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:41.412857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:41.545149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:41.553109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-23ad60c9-9382-49e6-8a0d-bbc8fd8b320d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.170722 Aug 09 12:27:41.553663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 273/554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:41 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:42.017199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:42.017830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:42.024242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:42.024759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:42.025186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:42.025862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:42.026311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:42.026728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:42.170711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:42.179265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:42.180812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:42.182004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f24753b5-9466-48ad-9aa1-b14d8a607218 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1750 microversion: 2.20 time: 0.169035 Aug 09 12:27:42.182550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 282/555] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:42 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:42.578391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:42.579084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:42.587471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:42.588074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:42.588678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:42.589531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:42.590096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:42.591292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:42.747306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:42.755845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9786f8ed-bd89-44b9-93af-175a7f7d4607 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1756 microversion: 2.1 time: 0.184127 Aug 09 12:27:42.756400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 274/556] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:42 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:43.207559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:43.208291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:43.216886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:43.217489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:43.218035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:43.218899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:43.219467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:43.219997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:43.365950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:43.379550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:43.382002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:43.383792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0b15d71d-951c-46e3-abfc-b044c930380f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1752 microversion: 2.20 time: 0.181043 Aug 09 12:27:43.384986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 283/557] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:43 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:43.777897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:43.778668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:43.786109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:43.786638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:43.787109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:43.787871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:43.788360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:43.788857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:43.936525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:43.944653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-57f94b94-bbd3-4214-ad45-2aec12ae2d3c tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1759 microversion: 2.1 time: 0.171116 Aug 09 12:27:43.945227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 275/558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:43 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:44.408145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:44.408832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:44.415515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:44.416029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:44.416485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:44.417177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:44.417624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:44.418047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:44.571239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:44.581633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:44.583102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:44.584341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd56e3a9-ed60-4bfa-b1fe-ace3e24a4d7d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1752 microversion: 2.20 time: 0.180191 Aug 09 12:27:44.584954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 284/559] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:44 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:45.609365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:45.609939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:45.616816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:45.617327 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:45.617788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:45.618480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:45.618931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:45.619325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:45.758735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:45.767374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:45.768870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:45.770016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1453d0a8-c6c2-4df0-80a7-684ae2e2ca00 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1752 microversion: 2.20 time: 0.166059 Aug 09 12:27:45.770535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 276/560] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:45 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:46.793889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:46.794553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:46.802289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:46.802992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:46.803704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:46.804795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:46.805447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:46.806080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:46.943201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:46.951919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:46.953382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:46.954538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-57c2745b-59ae-475b-a57b-aaf9600737d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1752 microversion: 2.20 time: 0.164792 Aug 09 12:27:46.955103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 285/561] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:46 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:47.673940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:27:47.676230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:47.682871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:47.683348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:47.683784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:47.684553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:47.685013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:47.685433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:47.707359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lazy-loading 'flavor' on Instance uuid 839a46e0-41c6-4467-b9fe-a7c9a478c27c {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:27:47.832855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b3ab2115-bb50-4704-82e2-5fc2f2248654 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/action" status: 200 len: 32 microversion: 2.1 time: 0.163002 Aug 09 12:27:47.833457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 277/562] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:27:47 2022] POST /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:27:47.843273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:47.843832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:47.859826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:47.860313 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:47.860818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:47.861550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:47.861965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:47.862382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:47.979001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:47.979679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:47.986707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:47.987311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:47.987792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:47.988507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:47.988950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:47.989365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:48.002641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:48.010822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6b5a30e1-f576-4fa4-b125-3da587214ea8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.171814 Aug 09 12:27:48.011377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 286/563] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:47 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:48.129004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:48.142195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:48.144663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:48.146393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6fbcf39d-445b-45f1-9b92-7e39ec1d185c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.171914 Aug 09 12:27:48.147257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 278/564] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:47 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:49.033217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:49.033792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:49.041295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:49.041853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:49.042339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:49.043101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:49.044122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:49.044287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:49.173879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:49.175063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:49.180409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:49.182460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:49.182938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:49.183455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:49.184061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:49.184605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:49.185316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:49.190292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f207c1ab-8bca-44b2-83fb-b984c403534b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.161689 Aug 09 12:27:49.190955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 287/565] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:49 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:49.331209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:49.340056 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:49.341912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:49.343301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-219f58b3-be3c-4d89-86be-10a32e4d30b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.174847 Aug 09 12:27:49.344314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 279/566] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:49 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:50.212913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:50.213589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:50.221044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:50.221664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:50.222331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:50.223284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:50.223811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:50.224309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:50.362798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:50.369037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:50.369780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:50.371987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e826034e-1fae-454b-af80-e45905b1cdd8 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.162953 Aug 09 12:27:50.372951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 288/567] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:50 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:50.377485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:50.377975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:50.378418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:50.379130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:50.379583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:50.380006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:50.522055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:50.531857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:50.533371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:50.534543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-abba0a6c-653f-4a3c-bc73-b506163eb80d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.169511 Aug 09 12:27:50.535109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 280/568] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:50 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:27:51.394094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:51.394702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:51.401519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:51.402042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:51.402550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:51.403292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:51.403748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:51.404186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:51.541237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:51.549907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-311f4332-0fdb-44b5-bb1d-a9eea98d9039 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.159687 Aug 09 12:27:51.550495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 289/569] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:51 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:51.559829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:51.560581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:51.562626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:51.567626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:51.568098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:51.568566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:51.569264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:51.569715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:51.570165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:51.705906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:51.714699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:51.716185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:51.717563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-09f20110-9dfb-4265-8ab4-4f0c4007d460 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.163775 Aug 09 12:27:51.718340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 281/570] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:51 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:52.571957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:52.573058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:52.582399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:52.583055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:52.583763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:52.584996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:52.585545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:52.586166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:52.609567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:52.740224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:52.740854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:52.749908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:52.750473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:52.751027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:52.752120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:52.752603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:52.753046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:52.764572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:52.781117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f18a1d8f-a0a6-4a5f-b215-cc7a0803df01 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.212632 Aug 09 12:27:52.781870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 290/571] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:52 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:52.915217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:52.925978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:52.927523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:52.928723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d91ea31f-539b-4bc4-9fa5-619f25d68f28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.192308 Aug 09 12:27:52.929411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 282/572] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:52 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:53.804980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:53.805640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:53.808121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:53.813209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:53.814047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:53.814737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:53.815564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:53.816109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:53.816809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:53.952700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:53.953642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:53.954270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:53.960877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-630b9f0b-4bcb-4c01-b5b4-28c48a9d0aad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.159864 Aug 09 12:27:53.961046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:53.961432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:53.961581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 291/573] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:53 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:53.961863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:53.962553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:53.963000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:53.963417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:54.100925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:54.109429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:54.110929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:54.112099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-82933e7e-6b1a-4cc5-8b32-29716a354d80 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.162745 Aug 09 12:27:54.112729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 283/574] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:53 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:54.982584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:54.983585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:54.990359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:54.990851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:54.991296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:54.992008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:54.992500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:54.992926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:55.128568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:55.135166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:55.136561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:55.137906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-555a2d59-2b2f-4f94-91b3-dde5d9d847ad tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.159275 Aug 09 12:27:55.146249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 292/575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:54 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:55.152968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:55.153457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:55.153984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:55.154776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:55.155226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:55.155646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:55.293981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:55.304004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:55.305586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:55.306752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e56fc1b3-0463-41df-bda6-1156b635fe5f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.175497 Aug 09 12:27:55.307320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 284/576] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:55 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:56.160479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:56.161090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:56.168100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:56.168612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:56.169040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:56.169739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:56.170184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:56.170596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:56.312507 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:56.320770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3a67a274-539e-4c06-b6e3-e540a242ef19 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.164283 Aug 09 12:27:56.321368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 293/577] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:56 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:56.331022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:56.331617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:56.338057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:56.338543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:56.339139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:56.339855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:56.340308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:56.340763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:56.476262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:56.485044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:56.486513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:56.487658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-97f16732-59b8-416a-9110-258f7f09e349 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.161302 Aug 09 12:27:56.488186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 285/578] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:56 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:57.341694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:57.342489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:57.349520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:57.350011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:57.350448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:57.351157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:57.351615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:57.352041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:57.493283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:57.502076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-60b25b89-44d2-4f9c-9b92-0154d995be72 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.164345 Aug 09 12:27:57.502654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 294/579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:57 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:57.511265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:57.512633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:57.519151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:57.519717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:57.520283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:57.521047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:57.521590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:57.522052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:57.654698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:57.664854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:57.666218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:57.667693 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-02cfc05a-2ce5-4567-9826-62b04790c0c3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.160172 Aug 09 12:27:57.668260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 286/580] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:57 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:58.526616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:58.527644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:58.536138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:58.536905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:58.537454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:58.538365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:58.538991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:58.539448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:58.693817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:58.699668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:58.700285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:58.703316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-07049d2a-bab2-4814-bea2-e7916c482324 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.182801 Aug 09 12:27:58.704101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 295/581] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:58 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:58.707815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:58.708601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:58.709027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:58.710005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:58.710603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:58.711169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:58.846572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:58.855509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:58.857063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:58.858808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-af02c708-b4cb-4870-bda8-f13ff1fbd982 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.163527 Aug 09 12:27:58.859392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 287/582] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:58 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:27:59.726918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:59.727500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:59.735420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:59.736055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:59.736597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:59.737309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:59.737763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:59.738184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:59.883488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:27:59.884104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:27:59.885044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:27:59.895740 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f333291-a461-4ad3-8377-8e1e3c17b63c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.173189 Aug 09 12:27:59.896602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 296/583] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:27:59 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:27:59.900997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:59.901506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:59.901946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:59.902663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:27:59.903125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:27:59.903547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:27:59.906616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:00.301796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:00.311088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:00.312680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:00.313861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-93956f2a-5143-4f07-a54b-0049f1111ec0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.434704 Aug 09 12:28:00.314756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 288/584] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:27:59 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:28:00.918453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:00.919090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:00.925722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:00.926215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:00.926684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:00.927377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:00.927846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:00.928271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:01.071010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:01.081638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1907a86e-aa88-40e5-b8ce-78fc2dfd20a6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.167121 Aug 09 12:28:01.082273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 297/585] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:00 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:01.337532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:01.338200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:01.345555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:01.346089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:01.346690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:01.348096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:01.348488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:01.349446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:01.493428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:01.503347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:01.504867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:01.506053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7543c8ee-97a6-42b9-a119-86b45af83fb6 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.172814 Aug 09 12:28:01.507757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 289/586] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:01 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:02.107237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:02.108330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:02.120139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:02.121020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:02.121785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:02.122848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:02.124046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:02.124627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:02.261762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:02.274026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4c3bbbed-2a6f-45b8-8f45-7903ee538490 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.173109 Aug 09 12:28:02.274892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 298/587] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:02 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:02.533417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:02.534164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:02.543725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:02.544437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:02.545090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:02.546134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:02.546787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:02.547396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:02.702960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:02.712060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:02.713576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:02.714721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e369f822-9f2c-4e61-8cb7-0cdede1eda07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.187991 Aug 09 12:28:02.715251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 290/588] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:02 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:03.303336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:03.304244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:03.315012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:03.315766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:03.316562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:03.317841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:03.318593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:03.319289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:03.460770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:03.469158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20ffd0f1-ca7e-40e5-9ac2-a40bfbd5c2aa tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.172383 Aug 09 12:28:03.469756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 299/589] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:03 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:03.741872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:03.742899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:03.753636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:03.754116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:03.754548 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:03.755237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:03.755684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:03.756097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:03.898463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:03.907145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:03.908681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:03.910132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9b5fc346-1f8d-41ba-8269-a2e128c2e395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.174900 Aug 09 12:28:03.910685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 291/590] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:03 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:04.490748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:04.491375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:04.498291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:04.499109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:04.499541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:04.500224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:04.500697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:04.501114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:04.645412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:04.653675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2616331-1e6f-472c-8547-765b7e9c8646 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.166921 Aug 09 12:28:04.654256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 300/591] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:04 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:04.934478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:04.935077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:04.942170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:04.942654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:04.943084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:04.943776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:04.944225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:04.944684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:05.085220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:05.094077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:05.095572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:05.096776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-32a68ce4-9afc-4794-b08a-b5ca9f17c395 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.166828 Aug 09 12:28:05.097344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 292/592] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:04 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:28:05.678742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:05.679363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:05.686704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:05.687233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:05.687708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:05.688518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:05.689010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:05.689476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:05.827723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:05.836098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a682c1ab-91d3-4483-af64-4f82b4a51f77 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.163646 Aug 09 12:28:05.836735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 301/593] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:05 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:06.125177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:06.126127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:06.137202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:06.138005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:06.138726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:06.139875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:06.140681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:06.141382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:06.272363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:06.281218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:06.282707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:06.283860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6244e2c2-e800-4ed0-be4c-a97e78d42e21 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.165685 Aug 09 12:28:06.284408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 293/594] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:06 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:06.863382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:06.864320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:06.871522 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:06.872005 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:06.872500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:06.873183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:06.873985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:06.874409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:07.025029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:07.033507 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-206a0b6f-b5ee-4620-8090-6394a86186cb tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.176892 Aug 09 12:28:07.034082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 302/595] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:06 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:07.311515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:07.312647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:07.322117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:07.322866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:07.323410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:07.324277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:07.324751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:07.325180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:07.471633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:07.481448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:07.482987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:07.484191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-41e9a719-757e-465b-ad7b-5164cd772c1c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.179737 Aug 09 12:28:07.484844 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 294/596] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:07 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:08.061287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:08.062244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:08.071467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:08.071943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:08.072364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:08.073073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:08.073524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:08.073937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:08.207877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:08.221074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-353f6112-eb6e-4dc1-aa97-8b1f277478cc tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.165954 Aug 09 12:28:08.221848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 303/597] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:08 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:08.513155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:08.514336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:08.524285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:08.524771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:08.525195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:08.525878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:08.526322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:08.526738 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:08.662485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:08.671432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:08.672969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:08.674114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d938485-0a4d-4e42-8620-767ca6784ed2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.168337 Aug 09 12:28:08.674671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 295/598] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:08 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:09.246299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:09.247015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:09.257488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:09.258118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:09.258753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:09.259762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:09.260394 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:09.260887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:09.405822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:09.414538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-48e66a4e-0213-48e9-aae0-522743ae8367 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.173729 Aug 09 12:28:09.415120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 304/599] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:09 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:09.700809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:09.701619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:09.710872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:09.711891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:09.712577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:09.713549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:09.714546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:09.715160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:09.859765 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:09.870276 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:09.871751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:09.872931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b2bdecb2-ce4c-4c94-9015-7708ec7f8cb4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.177560 Aug 09 12:28:09.873854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 296/600] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:09 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:10.440535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:10.441621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:10.449091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:10.449560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:10.449999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:10.450723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:10.451180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:10.451638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:10.589994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:10.600327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33a01250-2341-4e37-a9d8-c4aa5f04a756 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.166167 Aug 09 12:28:10.600819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 305/601] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:10 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:10.899639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:10.900247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:10.907012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:10.907502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:10.907939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:10.908695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:10.909147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:10.909571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:11.052208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:11.061154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:11.062649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:11.063825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0195a9ce-08bc-48ac-ad54-a3b7f3c2bc39 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.170390 Aug 09 12:28:11.064422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 297/602] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:10 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:28:11.624835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:11.625455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:11.632271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:11.633084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:11.633533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:11.634322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:11.634785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:11.635214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:11.769290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:11.782245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-03c8316a-37fd-4a96-aad3-0b42d5e43c2d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1736 microversion: 2.1 time: 0.161550 Aug 09 12:28:11.782938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 306/603] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:11 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:12.091131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:12.091934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:12.101911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:12.102619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:12.103214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:12.104181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:12.104857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:12.105443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:12.246352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:12.255697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:12.257346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:12.258504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ecd1ef60-7ada-432e-afa2-eb8015bf7176 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.172718 Aug 09 12:28:12.259067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 298/604] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:12 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:12.808537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:12.809257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:12.817430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:12.818087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:12.818569 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:12.819490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:12.820182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:12.820772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:12.825731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:12.960337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:12.968973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e4524ff-482d-4fff-8e0b-8b661b4f676f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1716 microversion: 2.1 time: 0.166101 Aug 09 12:28:12.969541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 307/605] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:12 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:13.032585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:13.033114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:13.039753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:13.040249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:13.040736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:13.041416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:13.041868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:13.042294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:13.167032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] HTTP exception thrown: Cannot 'detach_volume' instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c while it is in vm_state rescued Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Request method failure captured: Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments/f7309348-8506-497d-877c-70f7777e5a16 HTTP/1.1 Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFwgTp7Ky4KsSeKussN4JpllXGcA1oE4ep9CmV_KrFjQ5_NHiPKAtZFe7YvIK5gtA50qs5EI_NWt1Aeupm7u7-he8BxlzPHoSBB0qV9cTRogMVoES4LvcNS13xSQkS9EN0aDzIpI6NMih3bZ0TP8CzJD4XYJ8jSni7cAYmPn_PlDhw Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: eec8510663e74669969800e60e6c422b Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:28:13.168694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eec8510663e74669969800e60e6c422b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eec8510663e74669969800e60e6c422b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: eec8510663e74669969800e60e6c422b Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 7dcda8b6ba32416c86b329e2a4ee41e5 Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:28:13.170353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Cannot 'detach_volume' instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c while it is in vm_state rescued Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '839a46e0-41c6-4467-b9fe-a7c9a478c27c', 'id': 'f7309348-8506-497d-877c-70f7777e5a16'} Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:28:13.171238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c while it is in vm_state rescued Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c while it is in vm_state rescued Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:13.173410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Returning 409 to user: Cannot 'detach_volume' instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c while it is in vm_state rescued {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:28:13.174630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a0d26159-3648-4e0a-a30d-e43b4d2dd015 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments/f7309348-8506-497d-877c-70f7777e5a16" status: 409 len: 152 microversion: 2.1 time: 0.141986 Aug 09 12:28:13.174630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 299/606] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:28:13 2022] DELETE /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments/f7309348-8506-497d-877c-70f7777e5a16 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 12:28:13.183060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:13.183903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:13.192852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:13.193588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:13.194282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:13.195271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:13.195722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:13.196141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:13.272324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-65393b44-6032-419a-b334-e836430e67db tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "POST /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/action" status: 202 len: 0 microversion: 2.1 time: 0.095621 Aug 09 12:28:13.273083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 308/607] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:28:13 2022] POST /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:13.281492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:13.281809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:13.282099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:13.282498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:13.288978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:13.289556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:13.289983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:13.290678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:13.291128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:13.291550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:13.291989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:13.292515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:13.292954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:13.293659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:13.294116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:13.294542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:13.494595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:13.497935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:13.503555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:13.505163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:13.506386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45f73e9b-edfe-49e2-8f27-8dd58fe57976 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.228563 Aug 09 12:28:13.506584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6ee6019b-b12b-489b-8824-3735251e7138 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1724 microversion: 2.1 time: 0.229075 Aug 09 12:28:13.507135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 309/608] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:13 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:28:13.507297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 300/609] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:13 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:14.528236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:14.528882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:14.529677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:14.530333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:14.535560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:14.536022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:14.536472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:14.537097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:14.537253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:14.537572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:14.537722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:14.538029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:14.538176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:14.538885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:14.539159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:14.539579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:14.740304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:14.750832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:14.752248 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebab9b64-f82a-4899-96ba-e09bf98d0c5b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1724 microversion: 2.1 time: 0.227879 Aug 09 12:28:14.753143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 310/610] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:14 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:14.766041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:14.767665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:14.769172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5eb21b03-fece-417a-80ef-9bdeb7ea1c98 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.243417 Aug 09 12:28:14.769865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 301/611] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:14 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:15.777278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:15.777862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:15.784663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:15.785139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:15.785572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:15.786253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:15.786701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:15.787117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:15.792685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:15.793338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:15.800025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:15.800533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:15.800964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:15.801651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:15.802074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:15.802524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:15.988323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:15.997419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6481411c-4538-41ca-87c0-df67d2d5344f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1724 microversion: 2.1 time: 0.224081 Aug 09 12:28:15.997999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 311/612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:15 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:15.998976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:16.008329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:16.009855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:16.011014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6c1aa57e-d6f8-4925-acd6-834651de7a3f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.222289 Aug 09 12:28:16.011620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 302/613] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:15 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:16.938127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-2ea904d5-493a-4365-a667-b5c5f9eaeca0 req-c6e0c126-28ec-4233-abb5-4f2b4daa3589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af3fcd4-07fc-4de6-8634-f028e6c4f369", "name": "network-vif-plugged", "status": "completed", "tag": "2fce29dc-f113-418f-9748-cb44df959451"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:16.948675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2ea904d5-493a-4365-a667-b5c5f9eaeca0 req-c6e0c126-28ec-4233-abb5-4f2b4daa3589 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:16.948805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2ea904d5-493a-4365-a667-b5c5f9eaeca0 req-c6e0c126-28ec-4233-abb5-4f2b4daa3589 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:16.949137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2ea904d5-493a-4365-a667-b5c5f9eaeca0 req-c6e0c126-28ec-4233-abb5-4f2b4daa3589 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:16.960232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-2ea904d5-493a-4365-a667-b5c5f9eaeca0 req-c6e0c126-28ec-4233-abb5-4f2b4daa3589 service nova] Creating event network-vif-plugged:2fce29dc-f113-418f-9748-cb44df959451 for instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 on hv-cinder-85236 Aug 09 12:28:16.965671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-2ea904d5-493a-4365-a667-b5c5f9eaeca0 req-c6e0c126-28ec-4233-abb5-4f2b4daa3589 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092698 Aug 09 12:28:16.966277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 312/614] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:17.023187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:17.024121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:17.034427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:17.035118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:17.035739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:17.036767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:17.037511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:17.038446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:17.039279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:17.039964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:17.046498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:17.046976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:17.047399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:17.048077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:17.048558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:17.048977 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:17.230296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:17.234521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:17.238430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8d83baab-2420-4bf0-a5d6-fec43d81ce2e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1724 microversion: 2.1 time: 0.222050 Aug 09 12:28:17.239038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 303/615] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:17 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:17.243613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:17.245164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:17.246354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c75cf30f-b76b-4009-89ba-09890ae32ddb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.212999 Aug 09 12:28:17.246874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 313/616] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:17 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:18.264479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:18.265472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:18.274650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:18.275161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:18.275276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:18.275627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:18.276057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:18.276834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:18.277283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:18.277692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:18.281870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:18.282352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:18.282763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:18.283455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:18.283905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:18.284321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:18.476044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:18.478320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:18.479803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:18.485421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-27db1909-6206-4512-bd1c-9b202dd20648 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1724 microversion: 2.1 time: 0.227850 Aug 09 12:28:18.486003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 304/617] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:18 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:18.488665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:18.490269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:18.491519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a3c1538-f49f-4491-91d9-04488d9622a2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.222836 Aug 09 12:28:18.492185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 314/618] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:18 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:19.507789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:19.508876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:19.514830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:19.515719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:19.516119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:19.516254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:19.516665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:19.517329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:19.517798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:19.518192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:19.523268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:19.523739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:19.524173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:19.524908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:19.525357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:19.525774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:19.730572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:19.733892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:19.739459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:19.741078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:19.741839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-799084e8-111f-4a64-87ba-9e74c43f03ea tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1730 microversion: 2.1 time: 0.238307 Aug 09 12:28:19.742401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 305/619] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:19 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:19.742542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-367fb8c1-c27c-449a-afe0-fa1495004644 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.231596 Aug 09 12:28:19.743167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 315/620] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:19 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:19.762348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:19.762954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:19.769194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:19.769682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:19.770113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:19.770802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:19.771248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:19.771716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:19.857195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88905e80-1782-4220-9b45-8636fa1ec919 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098582 Aug 09 12:28:19.857794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 306/621] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 9 12:28:19 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:20.767486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:20.769778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:20.778814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:20.780372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:20.780916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:20.782087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:20.782755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:20.783182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:20.825910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-433de573-ebe2-457f-982f-2a13cffe7298 req-4c983058-3ade-4a74-945d-c14313932050 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839a46e0-41c6-4467-b9fe-a7c9a478c27c", "tag": "889c08ff-7822-4d8e-abf6-46dfadd00efd"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:20.836207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-433de573-ebe2-457f-982f-2a13cffe7298 req-4c983058-3ade-4a74-945d-c14313932050 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:20.837395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-433de573-ebe2-457f-982f-2a13cffe7298 req-4c983058-3ade-4a74-945d-c14313932050 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:20.838234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-433de573-ebe2-457f-982f-2a13cffe7298 req-4c983058-3ade-4a74-945d-c14313932050 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:20.850319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-433de573-ebe2-457f-982f-2a13cffe7298 req-4c983058-3ade-4a74-945d-c14313932050 service nova] Creating event network-changed:889c08ff-7822-4d8e-abf6-46dfadd00efd for instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c on hv-cinder-85236 Aug 09 12:28:20.855947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-433de573-ebe2-457f-982f-2a13cffe7298 req-4c983058-3ade-4a74-945d-c14313932050 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104847 Aug 09 12:28:20.856744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 316/622] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:20.926899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:20.935955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:20.937485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:20.938660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5c7b7b8-3906-4d36-b3b8-c7bb2dd64e25 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.176384 Aug 09 12:28:20.939222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 307/623] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:20 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:21.964089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:21.965580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:21.971763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:21.972335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:21.972852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:21.973597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:21.974106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:21.974587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:22.116739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:22.126055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:22.127543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:22.128726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-976dd6b4-cff4-43d3-80cb-795b9e942578 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1808 microversion: 2.20 time: 0.170065 Aug 09 12:28:22.129277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 317/624] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:21 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:22.877976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-34c58b11-37af-4386-aae2-2ab34f8942d5 req-4a30ebf2-1ceb-4c99-aca5-1a3479ed6432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839a46e0-41c6-4467-b9fe-a7c9a478c27c", "tag": "889c08ff-7822-4d8e-abf6-46dfadd00efd"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:22.886148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:22.892327 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-34c58b11-37af-4386-aae2-2ab34f8942d5 req-4a30ebf2-1ceb-4c99-aca5-1a3479ed6432 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:22.892828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-34c58b11-37af-4386-aae2-2ab34f8942d5 req-4a30ebf2-1ceb-4c99-aca5-1a3479ed6432 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:22.893254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-34c58b11-37af-4386-aae2-2ab34f8942d5 req-4a30ebf2-1ceb-4c99-aca5-1a3479ed6432 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:22.905106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-34c58b11-37af-4386-aae2-2ab34f8942d5 req-4a30ebf2-1ceb-4c99-aca5-1a3479ed6432 service nova] Creating event network-changed:889c08ff-7822-4d8e-abf6-46dfadd00efd for instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c on hv-cinder-85236 Aug 09 12:28:22.910434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-34c58b11-37af-4386-aae2-2ab34f8942d5 req-4a30ebf2-1ceb-4c99-aca5-1a3479ed6432 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039383 Aug 09 12:28:22.911017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 308/625] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:23.152847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:23.153528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:23.160080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:23.160907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:23.163441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:23.164149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:23.164641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:23.165132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:23.604176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:23.613222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:23.614718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:23.615872 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d604afe7-9ce6-4e51-9206-9eec08fa9f76 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1795 microversion: 2.20 time: 0.467224 Aug 09 12:28:23.616427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 318/626] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:28:23 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1795 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:28:24.780847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:24.781400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:24.787697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:24.788173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:24.788635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:24.789309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:24.789863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:24.790254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:24.872623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lazy-loading 'services' on Instance uuid 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:28:24.995227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b766da61-9c47-403e-ba73-0c4fa3dfc6d8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/os-volume_attachments/ad1f82ab-119b-4db6-8900-0186e18d968b" status: 202 len: 0 microversion: 2.1 time: 0.340299 Aug 09 12:28:24.995818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 309/627] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:28:24 2022] DELETE /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/os-volume_attachments/ad1f82ab-119b-4db6-8900-0186e18d968b => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:27.183889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a35197b3-208c-421d-86ef-4c93a381f090 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:27.186584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=56 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:27.191920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a35197b3-208c-421d-86ef-4c93a381f090 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:27.192421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a35197b3-208c-421d-86ef-4c93a381f090 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:27.192940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a35197b3-208c-421d-86ef-4c93a381f090 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:27.215895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a35197b3-208c-421d-86ef-4c93a381f090 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Going to try to stop instance {{(pid=117660) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 12:28:27.262961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a35197b3-208c-421d-86ef-4c93a381f090 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.083472 Aug 09 12:28:27.263542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 319/628] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:28:27 2022] POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:27.273133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:27.273816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:27.280950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:27.281476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:27.281905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:27.282601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:27.283047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:27.283472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:27.417275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:27.428339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-37f1c9fb-1dac-47e4-bf63-a44549de610a tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.159643 Aug 09 12:28:27.429139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 310/629] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:27 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:28.457184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:28.458328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:28.466756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:28.467242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:28.467679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:28.468369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:28.468861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:28.469287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:28.624246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:28.632148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92f0afe2-35ef-4209-a07f-a8aa3105a736 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.183133 Aug 09 12:28:28.632764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 320/630] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:28 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:29.657369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:29.658349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:29.668414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:29.668848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:29.669282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:29.669969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:29.670419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:29.670835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:29.811171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:29.819095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88ea14da-fc94-481c-9c56-793793a541b3 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.168615 Aug 09 12:28:29.819648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 311/631] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:29 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:30.842192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:30.842821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:30.849668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:30.850146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:30.850573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:30.851258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:30.851703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:30.852122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:30.984989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:30.992829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0b2ad22a-77ca-4a10-9c6a-a8ca5e5ac382 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.155227 Aug 09 12:28:30.993618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 321/632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:30 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:32.015289 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:32.015851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:32.022492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:32.022986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:32.023396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:32.024087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:32.024633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:32.025057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:32.162307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:32.170539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a90da1e2-ff9f-4172-b371-912a52c07852 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.159591 Aug 09 12:28:32.171150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 312/633] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:32 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:33.196056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:33.197025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:33.208231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:33.209166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:33.209879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:33.211000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:33.211943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:33.212699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:33.356225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:33.364251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2b6fad9a-7707-4671-a433-cbd23be82631 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.174712 Aug 09 12:28:33.364861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 322/634] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:33 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:34.389130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:34.389868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:34.398175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:34.398763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:34.399293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:34.400134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:34.400732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:34.401246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:34.557476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:34.565594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce10658a-3551-411f-9fcc-7621e8305b3c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.182310 Aug 09 12:28:34.566187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 313/635] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:34 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:35.599864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:35.600662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:35.609122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:35.609607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:35.610039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:35.610731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:35.611186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:35.611610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:35.616357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:35.758677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:35.768221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c414be90-8e7a-4679-b984-d821030a6883 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.173765 Aug 09 12:28:35.768799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 323/636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:35 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:36.795916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:36.796581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:36.803726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:36.804240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:36.804732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:36.805460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:36.805940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:36.806389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:36.944746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:36.953232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5023dd30-2450-4863-a0a6-64ae6c1ba81e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.161589 Aug 09 12:28:36.953802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 314/637] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:36 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:37.980885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:37.981632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:37.988413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:37.988966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:37.989420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:37.990145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:37.990626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:37.991069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:38.130901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:38.139880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ef31406-feeb-4510-90c1-df0a68cec05e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.164284 Aug 09 12:28:38.140192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 324/638] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:37 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:39.169243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:39.170102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:39.180181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:39.181035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:39.181715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:39.182890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:39.183771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:39.184699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:39.338111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:39.346374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-74ec170e-2a53-4316-9ca6-5878dcab7cc4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.184479 Aug 09 12:28:39.346944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 315/639] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:39 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:40.367377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:40.367962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:40.375258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:40.375740 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:40.376175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:40.376900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:40.377357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:40.377783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:40.519350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:40.527102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ea3c0e5-072f-438a-8fb9-8cbdeb77008d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.163774 Aug 09 12:28:40.527731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 325/640] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:40 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:41.547726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:41.548300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:41.555246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:41.555722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:41.556170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:41.556865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:41.557308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:41.557722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:41.693311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:41.701520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e835c54c-70da-417a-8d04-c3e78b5f9020 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.158066 Aug 09 12:28:41.702117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 316/641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:41 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:42.734496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:42.735559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:42.749154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:42.749635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:42.750070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:42.750760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:42.751207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:42.751629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:42.899563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:42.908334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-adcd69c6-a26f-4698-a7a4-f017d63f6653 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1675 microversion: 2.1 time: 0.180455 Aug 09 12:28:42.908971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 326/642] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:42 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:43.929154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:43.929764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:43.936999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:43.937484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:43.937921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:43.938609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:43.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:43.939484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:44.075771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:44.083610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7912f6a6-0c96-4b1b-a128-4e6c316c1c31 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1652 microversion: 2.1 time: 0.158419 Aug 09 12:28:44.084184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 317/643] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:43 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1652 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:44.104416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a1baad7-cccd-44cb-9a19-f5e67604f5a6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:44.111330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1baad7-cccd-44cb-9a19-f5e67604f5a6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:44.111806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1baad7-cccd-44cb-9a19-f5e67604f5a6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:44.112233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1baad7-cccd-44cb-9a19-f5e67604f5a6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:44.135323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a1baad7-cccd-44cb-9a19-f5e67604f5a6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Going to try to start instance {{(pid=117660) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 12:28:44.191206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a1baad7-cccd-44cb-9a19-f5e67604f5a6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/action" status: 202 len: 0 microversion: 2.1 time: 0.090254 Aug 09 12:28:44.191893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 327/644] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:28:44 2022] POST /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:44.202047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:44.202653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:44.209193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:44.209718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:44.210182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:44.210947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:44.211429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:44.211844 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:44.358636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:44.367635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-65ceaeec-78d0-4193-afba-0a9d0d291b79 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1661 microversion: 2.1 time: 0.170604 Aug 09 12:28:44.368237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 318/645] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:44 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1661 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:45.212190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:45.212800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:45.219236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.219714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.220142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.220867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.221313 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.221737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.245404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd974db5-5e80-4813-9bbf-c061500a6537 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496/ips" status: 200 len: 150 microversion: 2.1 time: 0.091102 Aug 09 12:28:45.245950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 328/646] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:28:45 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:45.261312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbf440b1-d03b-420a-bda0-9dbcf6908809"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:45.264496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:45.271270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.271744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.272177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.272901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.273344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.273762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.362872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Invalid volume: volume bbf440b1-d03b-420a-bda0-9dbcf6908809 is already attached to instances: f547825d-c0f5-40e7-8788-3a519b56ae51 Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: POST /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496/os-volume_attachments HTTP/1.1 Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 74 Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:28:45.364645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {"volumeAttachment": {"volumeId": "bbf440b1-d03b-420a-bda0-9dbcf6908809"}} Aug 09 12:28:45.366176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Invalid volume: volume bbf440b1-d03b-420a-bda0-9dbcf6908809 is already attached to instances: f547825d-c0f5-40e7-8788-3a519b56ae51 Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '566853b6-ba9c-4357-a910-7ddddde30496', 'body': {'volumeAttachment': {'volumeId': 'bbf440b1-d03b-420a-bda0-9dbcf6908809'}}} Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bbf440b1-d03b-420a-bda0-9dbcf6908809 is already attached to instances: f547825d-c0f5-40e7-8788-3a519b56ae51 Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:45.366980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bbf440b1-d03b-420a-bda0-9dbcf6908809 is already attached to instances: f547825d-c0f5-40e7-8788-3a519b56ae51 Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:45.368183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:28:45.369452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:28:45.369452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:28:45.369452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:28:45.369452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bbf440b1-d03b-420a-bda0-9dbcf6908809 is already attached to instances: f547825d-c0f5-40e7-8788-3a519b56ae51 Aug 09 12:28:45.369452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:45.369452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 400 to user: Invalid volume: volume bbf440b1-d03b-420a-bda0-9dbcf6908809 is already attached to instances: f547825d-c0f5-40e7-8788-3a519b56ae51 {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:28:45.369452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-feef01b4-0769-4481-a6d3-03be9aa92d23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111509 Aug 09 12:28:45.369452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 319/647] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:28:45 2022] POST /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:28:45.376975 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:45.377469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:45.383586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.384135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.384596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.385279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.385726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.386141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.389070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:45.389735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:45.396801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.397279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.397719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.398415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.398868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.399287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.411410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:28:45.492339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-af66d86f-9736-4581-972b-51ea795eeb6f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 204 len: 0 microversion: 2.1 time: 0.119486 Aug 09 12:28:45.493096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 329/648] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:28:45 2022] DELETE /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:28:45.504050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:45.504777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:45.510640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.511119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.511558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.512239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:45.512722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:45.513210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:45.535334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:45.543803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-94dabb9c-d778-418a-9f73-9ef05bf784fc tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1661 microversion: 2.1 time: 0.158685 Aug 09 12:28:45.544472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 320/649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:45 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:45.653594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:45.661706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c059c76-dd71-45b3-a9d8-e647a534a330 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1681 microversion: 2.1 time: 0.162468 Aug 09 12:28:45.662240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 330/650] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:45 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:46.566319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:46.566932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:46.574447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:46.574998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:46.575480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:46.576297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:46.577216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:46.577675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:46.690310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:46.691400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:46.699511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:46.700002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:46.700467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:46.701224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:46.702254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:46.702683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:46.720198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:46.723109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:46.729855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9d01b4cb-a2c1-4d74-b13f-5fcbd5f9e7a2 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1661 microversion: 2.1 time: 0.167479 Aug 09 12:28:46.730506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 321/651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:46 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1661 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:46.848064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:46.855754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c678d13-7d20-4154-bc5b-df040de455e5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1681 microversion: 2.1 time: 0.176872 Aug 09 12:28:46.856363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 331/652] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:46 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:47.757580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:47.758562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:47.768312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:47.768826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:47.769253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:47.769939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:47.770385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:47.770806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:47.877879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:47.878471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:47.891822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:47.891822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:47.892148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:47.892874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:47.893363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:47.893832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:47.903211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:47.911299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7b4b66e5-0755-49b8-a301-7996298e557c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1665 microversion: 2.1 time: 0.160085 Aug 09 12:28:47.911885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 322/653] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:47 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:48.033901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:48.041956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f566bb7d-eb71-44fa-8a82-fd5fa1451cd2 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1681 microversion: 2.1 time: 0.168277 Aug 09 12:28:48.042519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 332/654] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:47 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:49.063617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:49.064212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:49.070899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:49.071381 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:49.071826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:49.072533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:49.072977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:49.073393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:49.322336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:49.330586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7ecf534f-6e6d-41a4-bcc2-964de211a966 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 200 len: 1681 microversion: 2.1 time: 0.271004 Aug 09 12:28:49.331247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 323/655] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:49 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:49.558532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-b57ce3aa-dabf-42d0-852f-da76dd4d2362 req-137241dc-ca88-4139-b39b-2ef973dd1678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "566853b6-ba9c-4357-a910-7ddddde30496", "name": "network-vif-deleted", "tag": "7d4a9b10-8b5e-49b8-91f6-08422f8bf88d"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:49.569356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b57ce3aa-dabf-42d0-852f-da76dd4d2362 req-137241dc-ca88-4139-b39b-2ef973dd1678 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:49.569828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b57ce3aa-dabf-42d0-852f-da76dd4d2362 req-137241dc-ca88-4139-b39b-2ef973dd1678 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:49.570236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-b57ce3aa-dabf-42d0-852f-da76dd4d2362 req-137241dc-ca88-4139-b39b-2ef973dd1678 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:49.581706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-b57ce3aa-dabf-42d0-852f-da76dd4d2362 req-137241dc-ca88-4139-b39b-2ef973dd1678 service nova] Creating event network-vif-deleted:7d4a9b10-8b5e-49b8-91f6-08422f8bf88d for instance 566853b6-ba9c-4357-a910-7ddddde30496 on hv-cinder-85236 Aug 09 12:28:49.586476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-b57ce3aa-dabf-42d0-852f-da76dd4d2362 req-137241dc-ca88-4139-b39b-2ef973dd1678 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 Aug 09 12:28:49.590060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 333/656] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:50.352704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:50.353295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:50.360269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:50.360957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:50.361396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:50.362071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:50.362552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:50.362949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:50.377323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 HTTP/1.1 Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:28:50.379128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:28:50.380419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '566853b6-ba9c-4357-a910-7ddddde30496'} Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:28:50.381224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:28:50.382465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:50.383531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:28:50.383531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d6545ab-0153-40b0-97cb-ac0e98faf54c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 404 len: 111 microversion: 2.1 time: 0.032172 Aug 09 12:28:50.383531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 324/657] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:50 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:28:50.393930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17bc6f89-132a-44d3-8238-2c86b322f8a7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '.version_select at 0x7f0e082ff790>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:50.418619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17bc6f89-132a-44d3-8238-2c86b322f8a7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-295793974" status: 202 len: 0 microversion: 2.1 time: 0.029387 Aug 09 12:28:50.419454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 334/658] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Aug 9 12:28:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-295793974 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:51.107436 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:51.108110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:51.115118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:51.115651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:51.116168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:51.116894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:51.117343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:51.117760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:51.202413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lazy-loading 'services' on Instance uuid f547825d-c0f5-40e7-8788-3a519b56ae51 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:28:51.283442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aeb84a96-244e-43c1-aac5-c8f2728dd15f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments/bbf440b1-d03b-420a-bda0-9dbcf6908809" status: 202 len: 0 microversion: 2.1 time: 0.179819 Aug 09 12:28:51.284052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 325/659] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:28:51 2022] DELETE /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments/bbf440b1-d03b-420a-bda0-9dbcf6908809 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:51.293102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:51.295737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:51.302943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:51.303692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:51.304195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:51.305115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:51.305604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:51.306020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:51.339438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-61ac37b0-448e-4b95-b815-28c56cd0e74c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050874 Aug 09 12:28:51.340040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 335/660] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:28:51 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:52.357371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:52.361144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:52.371713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:52.372608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:52.373743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:52.374918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:52.375582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:52.376486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:52.407130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ab4ad1b-284d-4f0d-a386-aa353c0e6a37 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057400 Aug 09 12:28:52.407576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 326/661] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:28:52 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:53.419964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:53.422115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:53.429240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:53.430076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:53.430508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:53.431211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:53.431647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:53.432197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:53.468255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dcfc1750-487e-40d7-aad0-cfd66d509951 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051996 Aug 09 12:28:53.469017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 336/662] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:28:53 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:28:53.545245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:53.546140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:53.549129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=38 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:53.554696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:53.555184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:53.555620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:53.556362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:53.556966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:53.557692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:53.585485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:28:53.697148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d4fec0a6-a31e-40af-9cf1-d5983ab51f3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 204 len: 0 microversion: 2.1 time: 0.157538 Aug 09 12:28:53.698101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 327/663] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:28:53 2022] DELETE /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:28:53.709452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:53.710197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:53.716795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:53.717276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:53.717713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:53.718408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:53.718885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:53.719302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:53.876601 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:53.886934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-860ffc19-7bc3-43ef-9fa2-a86e3b15dcdd tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1683 microversion: 2.1 time: 0.181303 Aug 09 12:28:53.887800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 337/664] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:53 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:54.916064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:54.916796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:54.923916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:54.924363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:54.924864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:54.925551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:54.926000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:54.926416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:54.963326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-863823248"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:54.963902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:54.970780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:54.971268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:54.971698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:54.972411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:54.972870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:54.973289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:55.142361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:55.150210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ab4bff05-8dbf-4744-97fc-b3d847c75041 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1683 microversion: 2.1 time: 0.238399 Aug 09 12:28:55.151129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 328/665] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:54 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1683 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:28:55.237728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.network.security_group_api [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Removing security group 2247e5fd-6e02-4edc-83f9-e3d40a47d168 from port b92622b3-9938-4ed9-bd50-a1d8ff86458f Aug 09 12:28:56.081323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-78aad5a9-1309-4268-9acd-a249b5ed7188 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "POST /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/action" status: 202 len: 0 microversion: 2.1 time: 1.121905 Aug 09 12:28:56.081914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 338/666] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:28:54 2022] POST /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/action => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:56.091875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-7660ef17-5901-4463-9781-9452094caa74 req-522bb67c-8c12-4f12-9c59-37cc63b492b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1dbad9-b1fa-4279-b87e-d19ee96ba798", "tag": "b92622b3-9938-4ed9-bd50-a1d8ff86458f"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:56.102452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7660ef17-5901-4463-9781-9452094caa74 req-522bb67c-8c12-4f12-9c59-37cc63b492b6 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:56.103020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7660ef17-5901-4463-9781-9452094caa74 req-522bb67c-8c12-4f12-9c59-37cc63b492b6 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:56.104655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7660ef17-5901-4463-9781-9452094caa74 req-522bb67c-8c12-4f12-9c59-37cc63b492b6 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:56.117565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-7660ef17-5901-4463-9781-9452094caa74 req-522bb67c-8c12-4f12-9c59-37cc63b492b6 service nova] Creating event network-changed:b92622b3-9938-4ed9-bd50-a1d8ff86458f for instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 on hv-cinder-85236 Aug 09 12:28:56.123394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-7660ef17-5901-4463-9781-9452094caa74 req-522bb67c-8c12-4f12-9c59-37cc63b492b6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Aug 09 12:28:56.124927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 329/667] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:56.175009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:56.176776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:56.198449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:56.199234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:56.199922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:56.201781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:56.202660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:56.203307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:56.248722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:56.331461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:28:56.339868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5348ea9-07ec-49ee-b10e-3c3e04c3597e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 200 len: 1615 microversion: 2.1 time: 0.172489 Aug 09 12:28:56.341848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 339/668] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:56 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 1615 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:28:57.363854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:57.364729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:57.373043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:57.373633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:57.374157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:57.374968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:57.375589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:57.376072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:57.392197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 HTTP/1.1 Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:28:57.394319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:28:57.395901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': 'f547825d-c0f5-40e7-8788-3a519b56ae51'} Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:28:57.396828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:28:57.398295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:28:57.400219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:28:57.400219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a4e75598-6de7-481e-b8bf-9baa5735e80e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 404 len: 111 microversion: 2.1 time: 0.038803 Aug 09 12:28:57.400219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 330/669] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:28:57 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:28:57.408545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4aa1e177-9179-4e30-8402-042fc2c9eeb5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '.version_select at 0x7f0e08434ee0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:57.416671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:57.441121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4aa1e177-9179-4e30-8402-042fc2c9eeb5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-261245544" status: 202 len: 0 microversion: 2.1 time: 0.037484 Aug 09 12:28:57.444919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 340/670] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Aug 9 12:28:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-261245544 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:57.647398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:57.648075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:57.686463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:57.687120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:57.691873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:57.693409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:57.696195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:57.696753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:57.761604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-66c4ddae-2585-4849-ba85-695b06f1adad req-8bbb7f86-e0e3-4c67-913e-56d54e22adbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd1dbad9-b1fa-4279-b87e-d19ee96ba798", "tag": "b92622b3-9938-4ed9-bd50-a1d8ff86458f"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:57.782277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-66c4ddae-2585-4849-ba85-695b06f1adad req-8bbb7f86-e0e3-4c67-913e-56d54e22adbc service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:57.782771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-66c4ddae-2585-4849-ba85-695b06f1adad req-8bbb7f86-e0e3-4c67-913e-56d54e22adbc service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:57.783374 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-66c4ddae-2585-4849-ba85-695b06f1adad req-8bbb7f86-e0e3-4c67-913e-56d54e22adbc service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:57.795947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-66c4ddae-2585-4849-ba85-695b06f1adad req-8bbb7f86-e0e3-4c67-913e-56d54e22adbc service nova] Creating event network-changed:b92622b3-9938-4ed9-bd50-a1d8ff86458f for instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 on hv-cinder-85236 Aug 09 12:28:57.803088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-66c4ddae-2585-4849-ba85-695b06f1adad req-8bbb7f86-e0e3-4c67-913e-56d54e22adbc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152108 Aug 09 12:28:57.804533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 341/671] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:28:57.829035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lazy-loading 'services' on Instance uuid cd1dbad9-b1fa-4279-b87e-d19ee96ba798 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:28:57.927412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e859e2cf-83c0-4f6c-abdc-b87b0213be72 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments/1af7ec6e-b6e4-4df7-b1a0-96f4e981a389" status: 202 len: 0 microversion: 2.1 time: 0.289723 Aug 09 12:28:57.927992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 331/672] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:28:57 2022] DELETE /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments/1af7ec6e-b6e4-4df7-b1a0-96f4e981a389 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:28:57.939342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:57.941711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:57.954455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:57.955292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:57.955731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:57.956795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:57.957440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:57.958025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:57.989533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3c27705-07b0-4dc3-ad7b-03a639eb5b5e tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055794 Aug 09 12:28:57.990109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 342/673] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:28:57 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:28:58.142730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-68e56263-852b-4f79-8a67-70b4883a400d req-12bf837f-1fe9-4b90-9c92-97cf7afa7f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f547825d-c0f5-40e7-8788-3a519b56ae51", "name": "network-vif-deleted", "tag": "e12c36b3-adeb-4a4c-aa0d-1173e5045ba9"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:58.153371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-68e56263-852b-4f79-8a67-70b4883a400d req-12bf837f-1fe9-4b90-9c92-97cf7afa7f4a service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:58.154137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-68e56263-852b-4f79-8a67-70b4883a400d req-12bf837f-1fe9-4b90-9c92-97cf7afa7f4a service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:58.154731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-68e56263-852b-4f79-8a67-70b4883a400d req-12bf837f-1fe9-4b90-9c92-97cf7afa7f4a service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:58.167456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-68e56263-852b-4f79-8a67-70b4883a400d req-12bf837f-1fe9-4b90-9c92-97cf7afa7f4a service nova] Creating event network-vif-deleted:e12c36b3-adeb-4a4c-aa0d-1173e5045ba9 for instance f547825d-c0f5-40e7-8788-3a519b56ae51 on hv-cinder-85236 Aug 09 12:28:58.172862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-68e56263-852b-4f79-8a67-70b4883a400d req-12bf837f-1fe9-4b90-9c92-97cf7afa7f4a service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035273 Aug 09 12:28:58.173709 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 332/674] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:58.430647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f9cee8d-41c9-442c-a01e-f335d7897756 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: .version_select at 0x7f0e082ff1f0>, body: {"keypair": {"name": "tempest-keypair-1558414930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFZVvbLgMZXvp/aPAMckyeY92SZEluEaBILYk3+WJaNmJsYHrH+TKvzEAF0CxufJsRAY6K8KUrn5SM8WxBQq1rCQ3t3+J3uoNxmkDSwwba25T3Z67WlIac0u8Yt6m86oA=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:28:58.447352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9f9cee8d-41c9-442c-a01e-f335d7897756 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for project cffa9ae943de44bc8264914e39c80cfa. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:28:58.451222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-9f9cee8d-41c9-442c-a01e-f335d7897756 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for user c8982b93df5744bbbdeb7a956df06502 and project cffa9ae943de44bc8264914e39c80cfa. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:28:58.475827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f9cee8d-41c9-442c-a01e-f335d7897756 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049147 Aug 09 12:28:58.476513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 343/675] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:28:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:59.006214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:28:59.015229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:28:59.030184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:59.031533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:59.034298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:59.036359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:28:59.037227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:28:59.037893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:28:59.095472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-090f7fc8-7d27-4ae8-8f3f-af5f02a56002 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097293 Aug 09 12:28:59.101701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 333/676] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:28:58 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:28:59.934515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-282389479", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974a024c-61f1-4c3c-ba4e-fa1153d8a5d8"}], "security_groups": [{"name": "tempest-securitygroup--1385947163"}], "key_name": "tempest-keypair-1558414930", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:00.042959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] validate_networks() for [('974a024c-61f1-4c3c-ba4e-fa1153d8a5d8', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:29:00.109173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:00.111975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:00.119146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:00.119633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:00.120065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:00.121059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:00.121511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:00.121929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:00.154027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-444fdedb-5be6-4447-b3e0-4014ceb7d379 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049049 Aug 09 12:29:00.154791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 334/677] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:29:00 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:29:00.165291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:00.165757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:00.171738 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:00.172359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:00.172788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:00.173485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:00.173925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:00.174336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:00.251470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] HTTP exception thrown: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 is not attached to volume 1af7ec6e-b6e4-4df7-b1a0-96f4e981a389 Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Request method failure captured: Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments/1af7ec6e-b6e4-4df7-b1a0-96f4e981a389 HTTP/1.1 Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lICX0M2pnz-0s0WVLf5C-4veOlEp5oUCJ3bEYHU5mTDAdNqsbr1qrhbA8S0WYRHzfudkfhyAP4JOYE7-BDHHRpm6Ar_crxD19z_1RegnZuTIH3MN6YcNedF7xT8CgpeCsWO8mAqCpiQXfc36IlB2XrdxtpWZTRXm2qtyXsEAJQJZPA Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 125ff55150f6403ba0bccb148121a688 Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-TestMinimumBasicScenario-1966610338 Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:29:00.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/125ff55150f6403ba0bccb148121a688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/125ff55150f6403ba0bccb148121a688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_125ff55150f6403ba0bccb148121a688"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/125ff55150f6403ba0bccb148121a688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-TestMinimumBasicScenario-1966610338 Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 125ff55150f6403ba0bccb148121a688 Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1966610338 Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-TestMinimumBasicScenario-1966610338-project Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 483f96224f6040a98940f769e30d0e60 Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-TestMinimumBasicScenario-1966610338-project Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:29:00.255375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 is not attached to volume 1af7ec6e-b6e4-4df7-b1a0-96f4e981a389 Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'server_id': 'cd1dbad9-b1fa-4279-b87e-d19ee96ba798', 'id': '1af7ec6e-b6e4-4df7-b1a0-96f4e981a389'} Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1af7ec6e-b6e4-4df7-b1a0-96f4e981a389. Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:29:00.256213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 is not attached to volume 1af7ec6e-b6e4-4df7-b1a0-96f4e981a389 Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 is not attached to volume 1af7ec6e-b6e4-4df7-b1a0-96f4e981a389 Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:00.257789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Returning 404 to user: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 is not attached to volume 1af7ec6e-b6e4-4df7-b1a0-96f4e981a389 {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:29:00.258853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f746ae2b-20ca-4542-bb31-00270750a95d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments/1af7ec6e-b6e4-4df7-b1a0-96f4e981a389" status: 404 len: 154 microversion: 2.1 time: 0.094097 Aug 09 12:29:00.258853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 335/678] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:29:00 2022] DELETE /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798/os-volume_attachments/1af7ec6e-b6e4-4df7-b1a0-96f4e981a389 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:29:00.485208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:29:00.485750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:29:00.486252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:29:00.486655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:29:00.487064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:29:00.496533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:00.496991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:00.497430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:00.498476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:00.498918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:00.499332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:00.516518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for project cffa9ae943de44bc8264914e39c80cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:29:00.521023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for user c8982b93df5744bbbdeb7a956df06502 and project cffa9ae943de44bc8264914e39c80cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:29:00.533229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:29:00.535508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:29:00.585542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-636ba684-cfce-4635-9e02-494068572258 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655880 Aug 09 12:29:00.586074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 344/679] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:28:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:29:00.597406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9eaee840-36e1-45ac-a0ad-36e9cd7b7336 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:00.598179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9eaee840-36e1-45ac-a0ad-36e9cd7b7336 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:00.656444 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9eaee840-36e1-45ac-a0ad-36e9cd7b7336 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:00.664458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9eaee840-36e1-45ac-a0ad-36e9cd7b7336 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1241 microversion: 2.1 time: 0.070918 Aug 09 12:29:00.665075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 336/680] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:00 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:01.468441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:01.469001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:01.475374 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:01.475859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:01.476301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:01.477014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:01.477466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:01.477883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:01.504857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:29:01.587971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f137cdfd-fca7-432f-94c8-de689aa4f320 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "DELETE /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 204 len: 0 microversion: 2.1 time: 0.124376 Aug 09 12:29:01.588715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 345/681] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:29:01 2022] DELETE /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:29:01.597255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:01.598758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:01.608591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:01.609155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:01.609751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:01.610944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:01.611561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:01.612014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:01.687105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:01.687736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:01.693920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:01.694360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:01.694793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:01.695481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:01.695929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:01.696348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:01.770211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:01.775623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:01.778185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-090fbdc1-996d-4a3b-9f0f-84a2d6621840 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1301 microversion: 2.1 time: 0.095461 Aug 09 12:29:01.778741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 346/682] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:01 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:01.787166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88b1a5cd-9c8d-4d96-a0a4-1808e0f26fcd tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1554 microversion: 2.1 time: 0.194071 Aug 09 12:29:01.787735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 337/683] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:01 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:02.803696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:02.804521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:02.810500 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:02.811368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:02.813666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:02.814149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:02.814592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:02.815277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:02.815722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:02.816137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:02.819057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:02.819534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:02.819963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:02.820692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:02.821155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:02.821577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:02.885848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:02.894349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b0f4ec46-760d-4b6f-8c16-e6c707f52c3a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1301 microversion: 2.1 time: 0.096383 Aug 09 12:29:02.894924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 347/684] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:02 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:02.985666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:02.992981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-04db0141-69e0-48e2-855d-9a1f30cfcf02 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1554 microversion: 2.1 time: 0.187937 Aug 09 12:29:02.993543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 338/685] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:02 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:03.915446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:03.916138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:03.922603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:03.923074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:03.923612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:03.924352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:03.924823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:03.925235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:03.987508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:03.995159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-faf7a688-242e-470b-9890-f495272d6a39 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1299 microversion: 2.1 time: 0.083743 Aug 09 12:29:03.995756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 348/686] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:03 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:04.014617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:04.015223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:04.022209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:04.022689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:04.023113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:04.023802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:04.024248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:04.024695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:04.028715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:04.258387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:04.267985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e694de0-55ad-44f8-aada-5bddb15a82fc tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1554 microversion: 2.1 time: 0.257241 Aug 09 12:29:04.268646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 339/687] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:04 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1554 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:04.617602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-1d44c6bc-a77c-475f-9c75-3a6bddf0cd33 req-e53d1069-b39b-4232-af88-ccbb42ea87a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd1dbad9-b1fa-4279-b87e-d19ee96ba798", "name": "network-vif-deleted", "tag": "b92622b3-9938-4ed9-bd50-a1d8ff86458f"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:04.631961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1d44c6bc-a77c-475f-9c75-3a6bddf0cd33 req-e53d1069-b39b-4232-af88-ccbb42ea87a1 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:04.632632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1d44c6bc-a77c-475f-9c75-3a6bddf0cd33 req-e53d1069-b39b-4232-af88-ccbb42ea87a1 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:04.633065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-1d44c6bc-a77c-475f-9c75-3a6bddf0cd33 req-e53d1069-b39b-4232-af88-ccbb42ea87a1 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:04.645240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-1d44c6bc-a77c-475f-9c75-3a6bddf0cd33 req-e53d1069-b39b-4232-af88-ccbb42ea87a1 service nova] Creating event network-vif-deleted:b92622b3-9938-4ed9-bd50-a1d8ff86458f for instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 on hv-cinder-85236 Aug 09 12:29:04.651511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-1d44c6bc-a77c-475f-9c75-3a6bddf0cd33 req-e53d1069-b39b-4232-af88-ccbb42ea87a1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037111 Aug 09 12:29:04.652162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 349/688] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:04.926659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-0d6699d5-9090-44de-a61c-f0cfd5c06d04 req-25293a00-affa-4e2d-9d32-85d35a23cc27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca3852b-60ed-4fdd-92fc-ff09275d22f7", "tag": "0ac78168-8bf6-420f-9206-2d253e163fdc"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:04.936036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-0d6699d5-9090-44de-a61c-f0cfd5c06d04 req-25293a00-affa-4e2d-9d32-85d35a23cc27 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:04.936848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-0d6699d5-9090-44de-a61c-f0cfd5c06d04 req-25293a00-affa-4e2d-9d32-85d35a23cc27 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:04.937266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-0d6699d5-9090-44de-a61c-f0cfd5c06d04 req-25293a00-affa-4e2d-9d32-85d35a23cc27 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:04.948720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-0d6699d5-9090-44de-a61c-f0cfd5c06d04 req-25293a00-affa-4e2d-9d32-85d35a23cc27 service nova] Creating event network-changed:0ac78168-8bf6-420f-9206-2d253e163fdc for instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 on hv-cinder-85236 Aug 09 12:29:04.955202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-0d6699d5-9090-44de-a61c-f0cfd5c06d04 req-25293a00-affa-4e2d-9d32-85d35a23cc27 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032076 Aug 09 12:29:04.955988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 340/689] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:05.017600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:05.018299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:05.025309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:05.025804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:05.026240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:05.026944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:05.027399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:05.027823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:05.170355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:05.178729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6e814dbe-b54e-4277-9d15-af2cd2d95d02 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1367 microversion: 2.1 time: 0.165661 Aug 09 12:29:05.179279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 350/690] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:05 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:29:05.290392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:05.291090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:05.297888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:05.298507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:05.299174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:05.299872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:05.300321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:05.300762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:05.334641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:05.335399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:05.335989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:05.336629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lazy-loading 'fault' on Instance uuid cd1dbad9-b1fa-4279-b87e-d19ee96ba798 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:29:05.385001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '483f96224f6040a98940f769e30d0e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125ff55150f6403ba0bccb148121a688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:05.393973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c084eb36-764c-4d5e-a778-db59e7bd6270 tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 200 len: 1348 microversion: 2.1 time: 0.108472 Aug 09 12:29:05.394557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 341/691] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:05 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:06.200510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:06.201095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:06.208118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:06.208642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:06.209074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:06.209766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:06.210219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:06.210646 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:06.354574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:06.364849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a53a33d8-d798-42e2-96ec-9484f8d17c2e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1367 microversion: 2.1 time: 0.168549 Aug 09 12:29:06.365431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 351/692] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:06 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:06.415924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:06.416567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] [instance: cd1dbad9-b1fa-4279-b87e-d19ee96ba798] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:06.423502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:06.423987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:06.424408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:06.425138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:06.425590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:06.426010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:06.439652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] HTTP exception thrown: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 could not be found. Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Request method failure captured: Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 HTTP/1.1 Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lICX0M2pnz-0s0WVLf5C-4veOlEp5oUCJ3bEYHU5mTDAdNqsbr1qrhbA8S0WYRHzfudkfhyAP4JOYE7-BDHHRpm6Ar_crxD19z_1RegnZuTIH3MN6YcNedF7xT8CgpeCsWO8mAqCpiQXfc36IlB2XrdxtpWZTRXm2qtyXsEAJQJZPA Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 125ff55150f6403ba0bccb148121a688 Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-TestMinimumBasicScenario-1966610338 Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:29:06.441448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/125ff55150f6403ba0bccb148121a688"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/125ff55150f6403ba0bccb148121a688"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_125ff55150f6403ba0bccb148121a688"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/125ff55150f6403ba0bccb148121a688"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-TestMinimumBasicScenario-1966610338 Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 125ff55150f6403ba0bccb148121a688 Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1966610338 Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-TestMinimumBasicScenario-1966610338-project Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 483f96224f6040a98940f769e30d0e60 Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-TestMinimumBasicScenario-1966610338-project Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 could not be found. Aug 09 12:29:06.443031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': 'cd1dbad9-b1fa-4279-b87e-d19ee96ba798'} Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 could not be found. Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:29:06.443865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 could not be found. Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 could not be found. Aug 09 12:29:06.445427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:06.446768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Returning 404 to user: Instance cd1dbad9-b1fa-4279-b87e-d19ee96ba798 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:29:06.446768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-590169a7-4bb3-42dd-92fd-6da5f7ca987d tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798" status: 404 len: 111 microversion: 2.1 time: 0.030830 Aug 09 12:29:06.446768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 342/693] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:06 2022] GET /compute/v2.1/servers/cd1dbad9-b1fa-4279-b87e-d19ee96ba798 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:29:06.454278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a2f954f-c96b-462b-96dc-7406bbc3060f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] Calling method '.version_select at 0x7f0e08564280>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:06.476418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a2f954f-c96b-462b-96dc-7406bbc3060f tempest-TestMinimumBasicScenario-1966610338 tempest-TestMinimumBasicScenario-1966610338-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1524939798" status: 202 len: 0 microversion: 2.1 time: 0.028395 Aug 09 12:29:06.476988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 352/694] 10.222.0.60 () {58 vars in 1272 bytes} [Tue Aug 9 12:29:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1524939798 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:29:07.389062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:07.389633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:07.398834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:07.399560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:07.400003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:07.400905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:07.401476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:07.402042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:07.614124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:07.621920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2f7cd84e-c359-45d1-a430-b3b37d2cf01e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1367 microversion: 2.1 time: 0.238987 Aug 09 12:29:07.622797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 343/695] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:07 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:08.644570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:08.645308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:08.653386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:08.654511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:08.654949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:08.656132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:08.656617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:08.657089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:08.796292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:08.804605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2808da84-f41b-42d0-bc87-cf38da082e23 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1367 microversion: 2.1 time: 0.164954 Aug 09 12:29:08.805306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 353/696] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:08 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:09.826258 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:09.827658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:09.849299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:09.849963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:09.850503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:09.851313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:09.851875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:09.852450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:10.073328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:10.089039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e39236ef-ae54-475e-b1a9-4adc46799806 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1367 microversion: 2.1 time: 0.267123 Aug 09 12:29:10.089836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 344/697] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:09 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:11.110741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:11.111498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:11.115295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:11.115915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=10 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:11.119797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:11.120351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:11.120764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:11.121462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:11.121927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:11.122341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:11.184336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-a663a26e-fe19-429e-956b-807b59345727 req-3ab3048b-1354-490e-8aff-bc8255379745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca3852b-60ed-4fdd-92fc-ff09275d22f7", "name": "network-vif-plugged", "status": "completed", "tag": "0ac78168-8bf6-420f-9206-2d253e163fdc"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:11.194717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:11.199180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-a663a26e-fe19-429e-956b-807b59345727 req-3ab3048b-1354-490e-8aff-bc8255379745 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:11.200346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-a663a26e-fe19-429e-956b-807b59345727 req-3ab3048b-1354-490e-8aff-bc8255379745 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:11.201085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-a663a26e-fe19-429e-956b-807b59345727 req-3ab3048b-1354-490e-8aff-bc8255379745 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:11.215798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-a663a26e-fe19-429e-956b-807b59345727 req-3ab3048b-1354-490e-8aff-bc8255379745 service nova] Creating event network-vif-plugged:0ac78168-8bf6-420f-9206-2d253e163fdc for instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 on hv-cinder-85236 Aug 09 12:29:11.223971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-a663a26e-fe19-429e-956b-807b59345727 req-3ab3048b-1354-490e-8aff-bc8255379745 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045704 Aug 09 12:29:11.225496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 345/698] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:11.347239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:11.356912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c5821cd3-e7e8-43fd-ab13-f8f8e9e13cf6 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1367 microversion: 2.1 time: 0.249928 Aug 09 12:29:11.357688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 354/699] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:11 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:12.381409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:12.382454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:12.390403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:12.391042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:12.392191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:12.394384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:12.394958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:12.395636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:12.612503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:12.623233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e261dd42-f6b2-4197-8150-c065edc22752 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1367 microversion: 2.1 time: 0.246970 Aug 09 12:29:12.624096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 346/700] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:12 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:13.649286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:13.649755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:13.657249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:13.657809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:13.658337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:13.659322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:13.659921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:13.660866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:13.896612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:13.910487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-68d23fa3-0eaf-454e-9e8a-21d00e0c5e09 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1367 microversion: 2.1 time: 0.270869 Aug 09 12:29:13.911101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 355/701] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:13 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:29:14.932607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:14.933214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:14.939888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:14.940602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:14.941217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:14.942078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:14.942531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:14.942952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:15.079579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:15.087559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-45dcbdf0-6a1a-4640-b3b7-478432097663 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1558 microversion: 2.1 time: 0.158803 Aug 09 12:29:15.088509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 347/702] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:14 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:15.108926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:15.109412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:15.115942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:15.116453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:15.116884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:15.117568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:15.118015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:15.118454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:15.198905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a1719fd-b5f4-4594-bc5d-d9e042b5bca1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094441 Aug 09 12:29:15.199623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 356/703] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 9 12:29:15 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:16.197231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-d06802a7-34df-44e4-abbe-ca74230232a4 req-4cc97e36-b5aa-4bd4-8c9e-e4584d9e7e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca3852b-60ed-4fdd-92fc-ff09275d22f7", "tag": "0ac78168-8bf6-420f-9206-2d253e163fdc"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:16.207616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-d06802a7-34df-44e4-abbe-ca74230232a4 req-4cc97e36-b5aa-4bd4-8c9e-e4584d9e7e82 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:16.208147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-d06802a7-34df-44e4-abbe-ca74230232a4 req-4cc97e36-b5aa-4bd4-8c9e-e4584d9e7e82 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:16.208868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-d06802a7-34df-44e4-abbe-ca74230232a4 req-4cc97e36-b5aa-4bd4-8c9e-e4584d9e7e82 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:16.220131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-d06802a7-34df-44e4-abbe-ca74230232a4 req-4cc97e36-b5aa-4bd4-8c9e-e4584d9e7e82 service nova] Creating event network-changed:0ac78168-8bf6-420f-9206-2d253e163fdc for instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 on hv-cinder-85236 Aug 09 12:29:16.225202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-d06802a7-34df-44e4-abbe-ca74230232a4 req-4cc97e36-b5aa-4bd4-8c9e-e4584d9e7e82 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 Aug 09 12:29:16.225875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 348/704] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:27.381836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:27.382596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:27.386779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:27.387245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:27.395636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:27.396119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:27.396596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:27.397276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:27.397719 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:27.398132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:27.523910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lazy-loading 'services' on Instance uuid 839a46e0-41c6-4467-b9fe-a7c9a478c27c {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:29:27.643461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d6b6e4a-e289-4ecb-ab69-6454eaf38d51 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments/f7309348-8506-497d-877c-70f7777e5a16" status: 202 len: 0 microversion: 2.1 time: 0.262792 Aug 09 12:29:27.644087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 357/705] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:29:27 2022] DELETE /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments/f7309348-8506-497d-877c-70f7777e5a16 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:29:27.650389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:27.651137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=45 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:27.655617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:27.657903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:27.665401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:27.665883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:27.666321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:27.667016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:27.667468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:27.667936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:27.700700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c6912044-a6b8-4f2b-8a95-03c0e482a4b3 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051767 Aug 09 12:29:27.705270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 349/706] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:29:27 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:28.717931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:28.720241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:28.726889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:28.727361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:28.727789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:28.729440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:28.729929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:28.730368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:28.766186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c51528c0-e364-4e62-adaf-a5a75b593069 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054661 Aug 09 12:29:28.766899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 358/707] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:29:28 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:29.781537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:29.783679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:29.790592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:29.791070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:29.791497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:29.792180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:29.792655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:29.793070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:29.825247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7b7522f9-fc8c-49b5-b07d-34d0ffcce9e9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047469 Aug 09 12:29:29.825806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 350/708] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:29:29 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:29:29.905524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:29.906046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:29.912587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:29.913069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:29.913503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:29.914188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:29.914641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:29.915063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:29.940098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:29:30.024296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b74d9446-c04a-4059-9353-8011f1251e2f tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 204 len: 0 microversion: 2.1 time: 0.122602 Aug 09 12:29:30.024995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 359/709] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:29:29 2022] DELETE /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:29:30.033266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:30.033791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:30.039710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:30.040235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:30.040859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:30.041707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:30.042408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:30.042831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:30.180144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:30.188177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fd26a736-25fd-48c2-b107-398214a926d9 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1690 microversion: 2.1 time: 0.158885 Aug 09 12:29:30.188785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 351/710] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:30 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:31.214441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:31.215439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:31.226241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:31.227045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:31.227770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:31.228970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:31.229744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:31.230451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:31.361751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:31.369320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5ce114d-5130-4aff-a7a9-6217d5c6b9c1 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1690 microversion: 2.1 time: 0.162179 Aug 09 12:29:31.370100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 360/711] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:31 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:31.472329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:31.472865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:31.478979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:31.479495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:31.479901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:31.480623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:31.481074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:31.481519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:31.510401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fcea2776-79e8-44bf-b430-8185fe63b82b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments/3e0680e4-0a6a-4c2d-9984-d71fb752724d" status: 200 len: 194 microversion: 2.20 time: 0.272297 Aug 09 12:29:31.511001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 352/712] 10.222.0.60 () {60 vars in 1454 bytes} [Tue Aug 9 12:29:31 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments/3e0680e4-0a6a-4c2d-9984-d71fb752724d => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:29:31.582795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:31.583291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:31.589477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:31.589960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:31.590395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:31.591259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:31.591639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:31.592061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:31.674959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lazy-loading 'services' on Instance uuid 1af3fcd4-07fc-4de6-8634-f028e6c4f369 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:29:31.761897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a84608c0-6b41-4aea-8e78-9c90bb3bda7c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments/3e0680e4-0a6a-4c2d-9984-d71fb752724d" status: 202 len: 0 microversion: 2.20 time: 0.182931 Aug 09 12:29:31.762775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 361/713] 10.222.0.60 () {60 vars in 1457 bytes} [Tue Aug 9 12:29:31 2022] DELETE /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments/3e0680e4-0a6a-4c2d-9984-d71fb752724d => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:29:31.771549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:31.773830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:31.780021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:31.780537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:31.780988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:31.781668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:31.782114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:31.782524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:31.812211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-078f162b-3d39-4d0a-8bd3-953ee931076c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044662 Aug 09 12:29:31.812805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 353/714] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 9 12:29:31 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 12:29:32.396467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:32.397644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:32.406766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:32.407250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:32.407680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:32.408411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:32.408860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:32.409279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:32.553406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:32.566255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-41638776-e9bd-4e31-a4e8-041f7a408a47 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1690 microversion: 2.1 time: 0.177367 Aug 09 12:29:32.567174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 362/715] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:32 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:32.828815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:32.831593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:32.840803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:32.841498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:32.842032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:32.842955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:32.843571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:32.844155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:32.877353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e837aae2-db53-4793-8399-ffc4137e431d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054674 Aug 09 12:29:32.877904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 354/716] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 9 12:29:32 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:29:33.595262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:33.596221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:33.607436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:33.607910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:33.608341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:33.609058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:33.609504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:33.609906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:33.742596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:33.750757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a6e0c0e-a331-4947-b39a-aafc557e537d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1690 microversion: 2.1 time: 0.162189 Aug 09 12:29:33.751340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 363/717] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:33 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:33.890480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:33.893004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:33.899787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:33.900311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:33.900769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:33.901542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:33.901979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:33.902426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:33.938196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d373e82-ca0c-4569-b567-32f49a802933 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051879 Aug 09 12:29:33.938759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 355/718] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 9 12:29:33 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:29:34.771501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:34.772144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:34.779251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:34.779734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:34.780173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:34.780897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:34.781356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:34.781785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:34.946308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:34.951274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:34.954047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:34.954479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa81c822-9fa4-45a3-bece-96a0438415bd tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1690 microversion: 2.1 time: 0.186889 Aug 09 12:29:34.955287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 364/719] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:34 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:34.960668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:34.961153 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:34.961584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:34.962280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:34.962734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:34.963153 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:34.992189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4134a981-0d1e-40d2-899c-ea333acb33ae tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044978 Aug 09 12:29:34.992787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 356/720] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 9 12:29:34 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 12:29:35.771013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-e4d71ef9-095c-4aa3-8331-e18d0fa7a129 req-bf6e1aea-a517-43ac-8712-5164dfc2b715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839a46e0-41c6-4467-b9fe-a7c9a478c27c", "name": "network-vif-deleted", "tag": "889c08ff-7822-4d8e-abf6-46dfadd00efd"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:35.784808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e4d71ef9-095c-4aa3-8331-e18d0fa7a129 req-bf6e1aea-a517-43ac-8712-5164dfc2b715 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:35.786141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e4d71ef9-095c-4aa3-8331-e18d0fa7a129 req-bf6e1aea-a517-43ac-8712-5164dfc2b715 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:35.786770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e4d71ef9-095c-4aa3-8331-e18d0fa7a129 req-bf6e1aea-a517-43ac-8712-5164dfc2b715 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:35.800646 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-e4d71ef9-095c-4aa3-8331-e18d0fa7a129 req-bf6e1aea-a517-43ac-8712-5164dfc2b715 service nova] Creating event network-vif-deleted:889c08ff-7822-4d8e-abf6-46dfadd00efd for instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c on hv-cinder-85236 Aug 09 12:29:35.806501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-e4d71ef9-095c-4aa3-8331-e18d0fa7a129 req-bf6e1aea-a517-43ac-8712-5164dfc2b715 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039211 Aug 09 12:29:35.807858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 365/721] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:35.977615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:35.978967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:35.986972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:35.987444 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:35.987869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:35.988635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:35.989081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:35.989494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:36.005059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:36.008159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:36.014679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:36.015496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:36.015953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:36.016998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:36.017596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:36.018170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:36.022088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:36.022568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:36.023017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:36.023453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lazy-loading 'fault' on Instance uuid 839a46e0-41c6-4467-b9fe-a7c9a478c27c {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:29:36.049582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ae5b1ccc-3035-4389-9dd7-697618d40ab8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048793 Aug 09 12:29:36.050697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 366/722] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 9 12:29:35 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:29:36.069766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:36.078338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2e2683e1-0730-4d3f-a04a-9132a8ad87c6 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1335 microversion: 2.1 time: 0.106256 Aug 09 12:29:36.079643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 357/723] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:35 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:36.118863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:36.119361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:36.126153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:36.126598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:36.127032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:36.127706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:36.128150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:36.128607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:36.155433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:29:36.234474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f0de5f40-ccbd-43d2-a231-b41034d539b1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 204 len: 0 microversion: 2.20 time: 0.119302 Aug 09 12:29:36.235068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 367/724] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Aug 9 12:29:36 2022] DELETE /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 12:29:36.243475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:36.244079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:36.250745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:36.251232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:36.251664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:36.252361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:36.252942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:36.253365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:36.388992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:36.397679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:36.399176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:36.400624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0784764f-9540-4ef1-851a-ade6e8b67789 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.160911 Aug 09 12:29:36.401229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 358/725] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:36 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:37.105520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:37.106610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:37.113127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:37.113613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:37.114019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:37.114776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:37.115235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:37.115658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:37.148664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:37.149151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:37.149589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:37.150036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lazy-loading 'fault' on Instance uuid 839a46e0-41c6-4467-b9fe-a7c9a478c27c {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:29:37.194515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:37.202473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-53bac4c2-25cb-479b-a21c-1d0fa599350b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 200 len: 1335 microversion: 2.1 time: 0.104494 Aug 09 12:29:37.203040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 368/726] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:37 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:37.429006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:37.429915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:37.439568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:37.440051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:37.440506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:37.441201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:37.441646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:37.442061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:37.581721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:37.589799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:37.591511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:37.592697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-caead7e9-e25b-4f47-9ff0-933bdf6dfce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.170478 Aug 09 12:29:37.593259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 359/727] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:37 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:38.227452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:38.228513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 839a46e0-41c6-4467-b9fe-a7c9a478c27c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:38.239879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:38.240735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:38.241447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:38.242577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:38.243325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:38.244017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:38.250339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:38.260260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] HTTP exception thrown: Instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c could not be found. Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Request method failure captured: Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c HTTP/1.1 Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFwgTp7Ky4KsSeKussN4JpllXGcA1oE4ep9CmV_KrFjQ5_NHiPKAtZFe7YvIK5gtA50qs5EI_NWt1Aeupm7u7-he8BxlzPHoSBB0qV9cTRogMVoES4LvcNS13xSQkS9EN0aDzIpI6NMih3bZ0TP8CzJD4XYJ8jSni7cAYmPn_PlDhw Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: eec8510663e74669969800e60e6c422b Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:29:38.262223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eec8510663e74669969800e60e6c422b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eec8510663e74669969800e60e6c422b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: eec8510663e74669969800e60e6c422b Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 7dcda8b6ba32416c86b329e2a4ee41e5 Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c could not be found. Aug 09 12:29:38.264281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '839a46e0-41c6-4467-b9fe-a7c9a478c27c'} Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c could not be found. Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:29:38.265482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c could not be found. Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c could not be found. Aug 09 12:29:38.267114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:29:38.268710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Returning 404 to user: Instance 839a46e0-41c6-4467-b9fe-a7c9a478c27c could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:29:38.268710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d08af6bd-c5ec-415e-94ba-dea61ccf6106 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c" status: 404 len: 111 microversion: 2.1 time: 0.043251 Aug 09 12:29:38.268710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 369/728] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:38 2022] GET /compute/v2.1/servers/839a46e0-41c6-4467-b9fe-a7c9a478c27c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:29:38.274008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f15aa7d0-ec43-4612-9cd0-d0e9e1188485 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '.version_select at 0x7f0e0811edc0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:38.296679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f15aa7d0-ec43-4612-9cd0-d0e9e1188485 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888601664" status: 202 len: 0 microversion: 2.1 time: 0.026419 Aug 09 12:29:38.297227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 360/729] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 9 12:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888601664 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:29:38.616024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:38.616806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:38.625426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:38.626175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:38.626797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:38.627767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:38.628211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:38.628658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:38.919372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:38.927979 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:38.929612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:38.931109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd85fc50-467c-4a97-9c40-dc7ed10be0dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1723 microversion: 2.20 time: 0.319170 Aug 09 12:29:38.931837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 370/730] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:38 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:39.646728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-86c96c22-df4d-40cb-8890-e1a9239376ab req-452d5efe-6b70-4127-bf18-3ddc7d7a6a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af3fcd4-07fc-4de6-8634-f028e6c4f369", "name": "network-vif-deleted", "tag": "2fce29dc-f113-418f-9748-cb44df959451"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:39.660237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-86c96c22-df4d-40cb-8890-e1a9239376ab req-452d5efe-6b70-4127-bf18-3ddc7d7a6a38 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:39.660837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-86c96c22-df4d-40cb-8890-e1a9239376ab req-452d5efe-6b70-4127-bf18-3ddc7d7a6a38 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:39.661255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-86c96c22-df4d-40cb-8890-e1a9239376ab req-452d5efe-6b70-4127-bf18-3ddc7d7a6a38 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:39.674097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-86c96c22-df4d-40cb-8890-e1a9239376ab req-452d5efe-6b70-4127-bf18-3ddc7d7a6a38 service nova] Creating event network-vif-deleted:2fce29dc-f113-418f-9748-cb44df959451 for instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 on hv-cinder-85236 Aug 09 12:29:39.679136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-86c96c22-df4d-40cb-8890-e1a9239376ab req-452d5efe-6b70-4127-bf18-3ddc7d7a6a38 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036056 Aug 09 12:29:39.680082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 361/731] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:39.955001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:39.955520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:39.962138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:39.962628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:39.963079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:39.963775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:39.964209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:39.964650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:39.999117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:39.999594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:40.000020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:40.000501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lazy-loading 'fault' on Instance uuid 1af3fcd4-07fc-4de6-8634-f028e6c4f369 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:29:40.043372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:40.051709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:40.053255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:40.054420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6cd39bc7-2b16-485a-b7dd-b1bdd72c4042 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 200 len: 1371 microversion: 2.20 time: 0.103672 Aug 09 12:29:40.055142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 371/732] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:39 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:29:41.080405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:41.081102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:41.087436 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:41.087923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:41.088362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:41.089076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:41.089527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:41.089960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:41.103196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] HTTP exception thrown: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Request method failure captured: Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 HTTP/1.1 Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lH4IQ3ZwJ6PHnGmB-dNAvDoxr_2tS75Cz4Wi3L0Tj3VDcqLlrPVXqI8hnbMiOXyZJKdFu3EFWRiW36-4U6jRiECuJL4F-CO8sI3Urhj-B2RLq_DaqlWfrIZ4T8AG4X_ZMSuvyzfgeGBbBbeKTroPXhqOI56JRISTCd9VCzTHsC_h_I Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:29:41.104826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: b6717f94a3844d1b82817e0f4adcebad Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:29:41.106453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '1af3fcd4-07fc-4de6-8634-f028e6c4f369'} Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:29:41.107887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:29:41.109746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:41.110989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Returning 404 to user: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:29:41.110989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6e88eed5-17a6-4129-8d7b-b013c1449439 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 404 len: 111 microversion: 2.20 time: 0.031094 Aug 09 12:29:41.110989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 362/733] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:41 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:29:41.115324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7815047a-be6c-4895-94c0-95c75668321c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '.version_select at 0x7f0e083ba700>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:41.139366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7815047a-be6c-4895-94c0-95c75668321c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407050057" status: 204 len: 0 microversion: 2.20 time: 0.026810 Aug 09 12:29:41.140150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 372/734] 10.222.0.60 () {60 vars in 1262 bytes} [Tue Aug 9 12:29:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407050057 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 12:29:41.219382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:41.219874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:41.226340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:41.226650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:41.227094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:41.227756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:41.228195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:41.228737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:41.254007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:29:41.345596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ed46b230-81b2-45ad-a888-70dc74bc0496 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 204 len: 0 microversion: 2.1 time: 0.129826 Aug 09 12:29:41.346143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 363/735] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:29:41 2022] DELETE /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:29:41.354845 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:41.355474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:41.361640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:41.362365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:41.362805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:41.363510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:41.363966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:41.364414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:41.497902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:41.506487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b275dd83-50a8-43ea-87a5-97d72b6e7283 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1509 microversion: 2.1 time: 0.155731 Aug 09 12:29:41.507359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 373/736] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:41 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:41.819854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e81d38d1-8d02-464f-9854-256463ff1cb7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'create', calling method: .version_select at 0x7f0e0811eee0>, body: {"keypair": {"name": "tempest-keypair-160735014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2St+PbPcS07jSmtGRmLMv8qtFbbmyH1DXwW5fLvDejyoY5I2xzthzTnKdkGBC9LynqZyzzFX1HTNeU5AjeNNuG7cQ/ymtGlh2TsrLEtRliL96UW/lMFvSbUpBN6Xoadw=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:41.836318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-e81d38d1-8d02-464f-9854-256463ff1cb7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Getting quotas for project 12ee39a09d0b4e67898ac55e4fc8aaee. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:29:41.840567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-e81d38d1-8d02-464f-9854-256463ff1cb7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Getting quotas for user b6717f94a3844d1b82817e0f4adcebad and project 12ee39a09d0b4e67898ac55e4fc8aaee. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:29:41.866363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e81d38d1-8d02-464f-9854-256463ff1cb7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050858 Aug 09 12:29:41.866885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 364/737] 10.222.0.60 () {62 vars in 1200 bytes} [Tue Aug 9 12:29:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 12:29:42.529138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:42.529795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:42.537112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:42.537673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:42.538188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:42.539021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:42.539538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:42.540022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:42.638731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:42.659927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba0d690b-f7d6-4859-9f0a-a62caf300c68 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 200 len: 1467 microversion: 2.1 time: 0.134910 Aug 09 12:29:42.672790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 374/738] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:42 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 1467 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:42.719544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-b4b2018c-3064-476b-99be-1f0b5f708a68 req-74f03ecb-8733-4d9a-b48d-2fbdedfce739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a239bb-d81f-4ad7-b084-b2be4d75426d", "name": "network-vif-deleted", "tag": "4907d57d-ce20-40f7-9bb0-68e03189ce29"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:42.735098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b4b2018c-3064-476b-99be-1f0b5f708a68 req-74f03ecb-8733-4d9a-b48d-2fbdedfce739 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:42.735758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b4b2018c-3064-476b-99be-1f0b5f708a68 req-74f03ecb-8733-4d9a-b48d-2fbdedfce739 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:42.736191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b4b2018c-3064-476b-99be-1f0b5f708a68 req-74f03ecb-8733-4d9a-b48d-2fbdedfce739 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:42.753821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-b4b2018c-3064-476b-99be-1f0b5f708a68 req-74f03ecb-8733-4d9a-b48d-2fbdedfce739 service nova] Creating event network-vif-deleted:4907d57d-ce20-40f7-9bb0-68e03189ce29 for instance 15a239bb-d81f-4ad7-b084-b2be4d75426d on hv-cinder-85236 Aug 09 12:29:42.762228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-b4b2018c-3064-476b-99be-1f0b5f708a68 req-74f03ecb-8733-4d9a-b48d-2fbdedfce739 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050589 Aug 09 12:29:42.764687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 365/739] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:43.172599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1552555387", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efb3fa22-5bd2-43ad-a594-13a108bbc8d7"}], "security_groups": [{"name": "tempest-securitygroup--780292248"}], "key_name": "tempest-keypair-160735014", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:43.281464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] validate_networks() for [('efb3fa22-5bd2-43ad-a594-13a108bbc8d7', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:29:43.656984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:29:43.657565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:29:43.657868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:29:43.658273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:29:43.658673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:29:43.667917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:43.668398 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:43.668830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:43.669531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:43.669978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:43.670390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:43.687212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:43.687503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Getting quotas for project 12ee39a09d0b4e67898ac55e4fc8aaee. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:29:43.688043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 15a239bb-d81f-4ad7-b084-b2be4d75426d] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:43.691310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Getting quotas for user b6717f94a3844d1b82817e0f4adcebad and project 12ee39a09d0b4e67898ac55e4fc8aaee. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:29:43.694737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:43.695216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:43.695972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:43.696811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:43.697275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:43.697691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:43.703883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:29:43.706239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:29:43.712362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] HTTP exception thrown: Instance 15a239bb-d81f-4ad7-b084-b2be4d75426d could not be found. Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Request method failure captured: Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d HTTP/1.1 Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFwgTp7Ky4KsSeKussN4JpllXGcA1oE4ep9CmV_KrFjQ5_NHiPKAtZFe7YvIK5gtA50qs5EI_NWt1Aeupm7u7-he8BxlzPHoSBB0qV9cTRogMVoES4LvcNS13xSQkS9EN0aDzIpI6NMih3bZ0TP8CzJD4XYJ8jSni7cAYmPn_PlDhw Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: eec8510663e74669969800e60e6c422b Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:29:43.714244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eec8510663e74669969800e60e6c422b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eec8510663e74669969800e60e6c422b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: eec8510663e74669969800e60e6c422b Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 7dcda8b6ba32416c86b329e2a4ee41e5 Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 15a239bb-d81f-4ad7-b084-b2be4d75426d could not be found. Aug 09 12:29:43.715804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '15a239bb-d81f-4ad7-b084-b2be4d75426d'} Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a239bb-d81f-4ad7-b084-b2be4d75426d could not be found. Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:29:43.716877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a239bb-d81f-4ad7-b084-b2be4d75426d could not be found. Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a239bb-d81f-4ad7-b084-b2be4d75426d could not be found. Aug 09 12:29:43.718472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:43.720191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Returning 404 to user: Instance 15a239bb-d81f-4ad7-b084-b2be4d75426d could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:29:43.720191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-09351d2c-e7aa-4458-8b4e-e2ad4608420c tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d" status: 404 len: 111 microversion: 2.1 time: 0.033250 Aug 09 12:29:43.720191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 366/740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:43 2022] GET /compute/v2.1/servers/15a239bb-d81f-4ad7-b084-b2be4d75426d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:29:43.724881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:43.725374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:43.732235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:43.732879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:43.733328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:43.734044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:43.734461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:43.734877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:43.756955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf0545f4-5a0b-4f21-9084-6d9ce33e3b42 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.588779 Aug 09 12:29:43.757765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 375/741] 10.222.0.60 () {62 vars in 1188 bytes} [Tue Aug 9 12:29:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 12:29:43.761273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:29:43.769173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-228db538-123d-4723-b522-94fc07309adc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:43.769916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-228db538-123d-4723-b522-94fc07309adc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:43.775790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:43.832260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-228db538-123d-4723-b522-94fc07309adc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:43.840237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-228db538-123d-4723-b522-94fc07309adc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:43.842686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-228db538-123d-4723-b522-94fc07309adc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:43.843847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-228db538-123d-4723-b522-94fc07309adc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1281 microversion: 2.20 time: 0.078492 Aug 09 12:29:43.848519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 376/742] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:43 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:43.856126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cbec915e-acb5-4a68-9cfb-ac3163398c8b tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "DELETE /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 204 len: 0 microversion: 2.1 time: 0.134596 Aug 09 12:29:43.860465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 367/743] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:29:43 2022] DELETE /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:29:43.867552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:43.868157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:43.874931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:43.875412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:43.875843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:43.876571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:43.877165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:43.877563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:44.017213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:44.025092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e89a2101-c32b-4087-94e9-989e53433e0e tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.161568 Aug 09 12:29:44.025675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 377/744] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:43 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:44.873668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:44.874405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:44.881630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:44.882842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:44.883340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:44.884052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:44.884557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:44.885000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:44.954938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:44.963218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:44.964782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:44.965888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aa0c6447-c65f-45b8-93b6-65e714821fe4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1285 microversion: 2.20 time: 0.099557 Aug 09 12:29:44.966537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 368/745] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:44 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:45.050510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:45.051563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:45.062233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:45.062718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:45.063153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:45.063837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:45.064290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:45.064741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:45.203998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:45.211780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-149908fc-9eb9-4f1b-be22-4d2812718820 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.167845 Aug 09 12:29:45.212322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 378/746] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:45 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:45.993094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:45.994089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:46.005243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:46.006039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:46.006760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:46.007899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:46.008725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:46.009418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:46.077143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:46.085817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:46.087332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:46.088480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-12702dc4-492e-4dcb-84fd-7653bba30560 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1285 microversion: 2.20 time: 0.102159 Aug 09 12:29:46.089076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 369/747] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:45 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:46.232115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:46.232957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:46.239851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:46.240337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:46.240802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:46.241496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:46.241947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:46.242367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:46.378767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:46.386748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92c2fb41-e172-4543-bb68-51473dbafaca tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.158566 Aug 09 12:29:46.387316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 379/748] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:46 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:47.111986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:47.112935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:47.120941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:47.121501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:47.122346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:47.123374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:47.124039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:47.124492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:47.213005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:47.221987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:47.223788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:47.225135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ae9d08f0-b985-4007-8dda-29ebc5b6d8dc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1333 microversion: 2.20 time: 0.117680 Aug 09 12:29:47.225794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 370/749] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:47 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1333 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:47.408554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:47.409307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:47.423871 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:47.425608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:47.427365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:47.429454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:47.436925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-28ffb274-3a13-481c-aecd-3250bbcb37c6 req-fa8bd127-84ac-4f6f-9304-118007142bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138f9e3b-bbbe-4ef3-9108-e66e8911f81c", "name": "network-vif-unplugged", "status": "completed", "tag": "77debbd0-dda5-40b2-9a29-5390ecf3a5ec"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:47.443368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:47.445203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:47.457495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-28ffb274-3a13-481c-aecd-3250bbcb37c6 req-fa8bd127-84ac-4f6f-9304-118007142bcb service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:47.458076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-28ffb274-3a13-481c-aecd-3250bbcb37c6 req-fa8bd127-84ac-4f6f-9304-118007142bcb service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:47.459094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-28ffb274-3a13-481c-aecd-3250bbcb37c6 req-fa8bd127-84ac-4f6f-9304-118007142bcb service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:47.475776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-28ffb274-3a13-481c-aecd-3250bbcb37c6 req-fa8bd127-84ac-4f6f-9304-118007142bcb service nova] Creating event network-vif-unplugged:77debbd0-dda5-40b2-9a29-5390ecf3a5ec for instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c on hv-cinder-85236 Aug 09 12:29:47.489165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-28ffb274-3a13-481c-aecd-3250bbcb37c6 req-fa8bd127-84ac-4f6f-9304-118007142bcb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057635 Aug 09 12:29:47.491041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 371/750] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:29:47.697942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dcda8b6ba32416c86b329e2a4ee41e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eec8510663e74669969800e60e6c422b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:47.712318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-76d10a17-d9ed-4f32-8cc7-2e0118254547 req-e7730d11-bee9-42ec-bd4b-4373c595fa11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "138f9e3b-bbbe-4ef3-9108-e66e8911f81c", "name": "network-vif-deleted", "tag": "77debbd0-dda5-40b2-9a29-5390ecf3a5ec"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:47.721011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86e3c211-61bc-4ebf-b6c1-d30e130f790d tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 200 len: 1523 microversion: 2.1 time: 0.316520 Aug 09 12:29:47.724960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 380/751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:47 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:47.746651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-76d10a17-d9ed-4f32-8cc7-2e0118254547 req-e7730d11-bee9-42ec-bd4b-4373c595fa11 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:47.747666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-76d10a17-d9ed-4f32-8cc7-2e0118254547 req-e7730d11-bee9-42ec-bd4b-4373c595fa11 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:47.748553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-76d10a17-d9ed-4f32-8cc7-2e0118254547 req-e7730d11-bee9-42ec-bd4b-4373c595fa11 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:47.764696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-76d10a17-d9ed-4f32-8cc7-2e0118254547 req-e7730d11-bee9-42ec-bd4b-4373c595fa11 service nova] Creating event network-vif-deleted:77debbd0-dda5-40b2-9a29-5390ecf3a5ec for instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c on hv-cinder-85236 Aug 09 12:29:47.771047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-76d10a17-d9ed-4f32-8cc7-2e0118254547 req-e7730d11-bee9-42ec-bd4b-4373c595fa11 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063510 Aug 09 12:29:47.771649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 372/752] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:29:48.249479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:48.250020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:48.257328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:48.257914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:48.258515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:48.259609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:48.260331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:48.261075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:48.405131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:48.413613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:48.415140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:48.416463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3dad9379-074f-44de-b4bd-a593bdfda4c4 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1406 microversion: 2.20 time: 0.171452 Aug 09 12:29:48.417208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 381/753] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:48 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:48.748871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:48.749726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] [instance: 138f9e3b-bbbe-4ef3-9108-e66e8911f81c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:48.756535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:48.757003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:48.757573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:48.758243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:48.758694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:48.759110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:48.772728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] HTTP exception thrown: Instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c could not be found. Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Request method failure captured: Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c HTTP/1.1 Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFwgTp7Ky4KsSeKussN4JpllXGcA1oE4ep9CmV_KrFjQ5_NHiPKAtZFe7YvIK5gtA50qs5EI_NWt1Aeupm7u7-he8BxlzPHoSBB0qV9cTRogMVoES4LvcNS13xSQkS9EN0aDzIpI6NMih3bZ0TP8CzJD4XYJ8jSni7cAYmPn_PlDhw Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: eec8510663e74669969800e60e6c422b Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:29:48.774426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/eec8510663e74669969800e60e6c422b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_eec8510663e74669969800e60e6c422b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/eec8510663e74669969800e60e6c422b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: eec8510663e74669969800e60e6c422b Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-271241002 Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 7dcda8b6ba32416c86b329e2a4ee41e5 Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-ServerRescueNegativeTestJSON-271241002-project Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c could not be found. Aug 09 12:29:48.775998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '138f9e3b-bbbe-4ef3-9108-e66e8911f81c'} Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c could not be found. Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:29:48.777248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c could not be found. Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c could not be found. Aug 09 12:29:48.779060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:29:48.780808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] Returning 404 to user: Instance 138f9e3b-bbbe-4ef3-9108-e66e8911f81c could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:29:48.780808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-07c3defe-551d-4cd6-9760-8ac321350554 tempest-ServerRescueNegativeTestJSON-271241002 tempest-ServerRescueNegativeTestJSON-271241002-project] 10.222.0.60 "GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c" status: 404 len: 111 microversion: 2.1 time: 0.032210 Aug 09 12:29:48.780808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 373/754] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:48 2022] GET /compute/v2.1/servers/138f9e3b-bbbe-4ef3-9108-e66e8911f81c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:29:49.095174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-7c500e48-fad9-4e76-99b7-5f823f28b8a3 req-e3f54ceb-64c4-441f-b867-52d1f3318a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74", "tag": "5ba0f75a-7788-4550-a660-9c0021b0abc0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:49.108326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7c500e48-fad9-4e76-99b7-5f823f28b8a3 req-e3f54ceb-64c4-441f-b867-52d1f3318a45 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:49.108967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7c500e48-fad9-4e76-99b7-5f823f28b8a3 req-e3f54ceb-64c4-441f-b867-52d1f3318a45 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:49.109384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-7c500e48-fad9-4e76-99b7-5f823f28b8a3 req-e3f54ceb-64c4-441f-b867-52d1f3318a45 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:49.122981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-7c500e48-fad9-4e76-99b7-5f823f28b8a3 req-e3f54ceb-64c4-441f-b867-52d1f3318a45 service nova] Creating event network-changed:5ba0f75a-7788-4550-a660-9c0021b0abc0 for instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 on hv-cinder-85236 Aug 09 12:29:49.128144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-7c500e48-fad9-4e76-99b7-5f823f28b8a3 req-e3f54ceb-64c4-441f-b867-52d1f3318a45 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037199 Aug 09 12:29:49.128782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 382/755] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:49.439581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:49.440563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:49.446985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:49.447456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:49.447877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:49.448831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:49.449464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:49.450064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:49.665585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:49.673932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:49.675412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:49.676539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a0420179-4870-4faf-82d3-7c9fef27225e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1406 microversion: 2.20 time: 0.241108 Aug 09 12:29:49.677096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 374/756] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:49 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:50.699891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:50.700970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:50.707856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:50.708443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:50.708882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:50.709612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:50.710029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:50.710669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:50.925789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:50.933919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:50.935472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:50.936969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-358f73aa-efac-42c8-a24d-48c46a967d81 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1406 microversion: 2.20 time: 0.241349 Aug 09 12:29:50.937721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 383/757] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:50 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:51.960981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:51.961848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:51.971538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=4 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:51.975581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:51.976070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:51.976527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:51.977245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:51.977689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:51.978106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:52.138664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:52.149951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:52.151466 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:52.152784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b5ceab47-9a1f-4218-bd07-a51c54e81bf9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1406 microversion: 2.20 time: 0.195621 Aug 09 12:29:52.154589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 375/758] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:51 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:53.177503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:53.178825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:53.187098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:53.187824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:53.188534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:53.189717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:53.190777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:53.191783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:53.356677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:53.365761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:53.367417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:53.368722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0da0003-cd7d-45f3-86e5-6d65ebb84a36 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1406 microversion: 2.20 time: 0.195109 Aug 09 12:29:53.369311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 384/759] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:53 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:54.397545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:54.398144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:54.406560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:54.407065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:54.407499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:54.408207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:54.408691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:54.409104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:54.560769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:54.570001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:54.571538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:54.572694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9a318dbc-d5a3-4df8-8bc0-d2d9cb7846d7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1406 microversion: 2.20 time: 0.183452 Aug 09 12:29:54.573285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 376/760] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:54 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:55.372255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-44f1a7f0-2984-4e16-bd98-87328e4a945e req-0261c9c5-fef9-4677-b43d-301dcd8c4dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74", "name": "network-vif-plugged", "status": "completed", "tag": "5ba0f75a-7788-4550-a660-9c0021b0abc0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:55.378343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:55.379054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=8 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:55.386474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-44f1a7f0-2984-4e16-bd98-87328e4a945e req-0261c9c5-fef9-4677-b43d-301dcd8c4dfa service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:55.386948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-44f1a7f0-2984-4e16-bd98-87328e4a945e req-0261c9c5-fef9-4677-b43d-301dcd8c4dfa service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:55.387375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-44f1a7f0-2984-4e16-bd98-87328e4a945e req-0261c9c5-fef9-4677-b43d-301dcd8c4dfa service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:55.400260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-44f1a7f0-2984-4e16-bd98-87328e4a945e req-0261c9c5-fef9-4677-b43d-301dcd8c4dfa service nova] Creating event network-vif-plugged:5ba0f75a-7788-4550-a660-9c0021b0abc0 for instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 on hv-cinder-85236 Aug 09 12:29:55.405707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-44f1a7f0-2984-4e16-bd98-87328e4a945e req-0261c9c5-fef9-4677-b43d-301dcd8c4dfa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039247 Aug 09 12:29:55.406826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 385/761] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:29:55.597900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:55.598688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:55.605019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:55.605511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:55.605947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:55.606648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:55.607137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:55.607560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:55.798697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:55.807399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:55.808942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:55.810103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-127c7925-f7e4-4eb7-a5b8-cc2bb67db8d3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1406 microversion: 2.20 time: 0.216172 Aug 09 12:29:55.810659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 377/762] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:55 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:56.247926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:56.250198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:56.256446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:56.257011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:56.257511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:56.258219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:56.258677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:56.259100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:56.288314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f51e8c0-0b6d-40f6-84dc-4ff55dcf59a4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045151 Aug 09 12:29:56.289208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 386/763] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:29:56 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:29:56.355285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:56.359096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:56.365131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:56.365819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:56.366243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:56.366940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:56.367387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:56.367807 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:56.394366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:29:56.475761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c7dd523-057c-4e31-a7bd-844c7e4a47af tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 204 len: 0 microversion: 2.1 time: 0.123892 Aug 09 12:29:56.476437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 378/764] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:29:56 2022] DELETE /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:29:56.485085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:56.485700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:56.492183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:56.492649 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:56.493086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:56.493780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:56.494240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:56.494664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:56.629557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:56.637015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e74aae62-f747-4b59-b1bb-bca7838dbc9c tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1671 microversion: 2.1 time: 0.156111 Aug 09 12:29:56.637581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 387/765] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:56 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:56.833091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:56.833815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:56.840002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:56.840544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:56.840983 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:56.841828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:56.842446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:56.842862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:56.986405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:56.994673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:56.996164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:56.997934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-165948df-9ea4-4839-acd4-75b6b6573b28 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1406 microversion: 2.20 time: 0.169050 Aug 09 12:29:56.998474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 379/766] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:56 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:57.661106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:57.661106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:57.661906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:57.667254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:57.667693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:57.668112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:57.668843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:57.669306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:57.670262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:57.810484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:57.818308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71505bee-d2d6-4630-bb15-564c9a05e919 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1671 microversion: 2.1 time: 0.163489 Aug 09 12:29:57.818878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 388/767] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:57 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:58.020045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:58.020639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:58.023083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:58.029172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:58.029636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:58.030213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:58.030951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:58.031403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:58.031862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:58.173264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:58.181851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:58.183330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:58.184621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c5594cec-8a15-41ea-bcb4-1b9bad9ece17 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1597 microversion: 2.20 time: 0.168421 Aug 09 12:29:58.185438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 380/768] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:29:58 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1597 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:29:58.207602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:58.208036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:58.216047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:58.216670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:58.217074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:58.217804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:58.218862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:58.219473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:58.316025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17a344e0-4861-4090-974b-3ad104488aa3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.112486 Aug 09 12:29:58.316722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 389/769] 10.222.0.60 () {60 vars in 1316 bytes} [Tue Aug 9 12:29:58 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:29:58.840047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:29:58.841148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:29:58.847657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:58.848112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:58.848781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:58.849667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:58.850325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:58.850788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:59.082118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:29:59.091247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ba63176c-72ae-4858-a47f-a524c107de10 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1671 microversion: 2.1 time: 0.255002 Aug 09 12:29:59.092079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 381/770] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:29:58 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1671 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:29:59.506090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-dcfd32aa-3d0c-4763-a590-0506432b03c1 req-07fb9cc9-1adb-4f08-b1bc-f60f82ccdf0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74", "tag": "5ba0f75a-7788-4550-a660-9c0021b0abc0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:29:59.522017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-dcfd32aa-3d0c-4763-a590-0506432b03c1 req-07fb9cc9-1adb-4f08-b1bc-f60f82ccdf0f service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:29:59.522948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-dcfd32aa-3d0c-4763-a590-0506432b03c1 req-07fb9cc9-1adb-4f08-b1bc-f60f82ccdf0f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:29:59.523480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-dcfd32aa-3d0c-4763-a590-0506432b03c1 req-07fb9cc9-1adb-4f08-b1bc-f60f82ccdf0f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:29:59.543082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-dcfd32aa-3d0c-4763-a590-0506432b03c1 req-07fb9cc9-1adb-4f08-b1bc-f60f82ccdf0f service nova] Creating event network-changed:5ba0f75a-7788-4550-a660-9c0021b0abc0 for instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 on hv-cinder-85236 Aug 09 12:29:59.550850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-dcfd32aa-3d0c-4763-a590-0506432b03c1 req-07fb9cc9-1adb-4f08-b1bc-f60f82ccdf0f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049356 Aug 09 12:29:59.552371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 390/771] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:30:00.113361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:00.114742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:00.123838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:00.124428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:00.124956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:00.125792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:00.126563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:00.129136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:00.155637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-f0f7b4d4-f8d6-4198-96cb-1b774c35641f req-0a79584e-4b67-4c14-823c-a36a08df8220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56388ec4-a642-4d87-a2a1-da60a5c0f9f5", "name": "network-vif-deleted", "tag": "cdeb0c4e-c7ea-4941-a99c-2b329d11b818"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:00.172049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f0f7b4d4-f8d6-4198-96cb-1b774c35641f req-0a79584e-4b67-4c14-823c-a36a08df8220 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:00.173032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f0f7b4d4-f8d6-4198-96cb-1b774c35641f req-0a79584e-4b67-4c14-823c-a36a08df8220 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:00.173928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f0f7b4d4-f8d6-4198-96cb-1b774c35641f req-0a79584e-4b67-4c14-823c-a36a08df8220 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:00.179291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:00.188569 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-f0f7b4d4-f8d6-4198-96cb-1b774c35641f req-0a79584e-4b67-4c14-823c-a36a08df8220 service nova] Creating event network-vif-deleted:cdeb0c4e-c7ea-4941-a99c-2b329d11b818 for instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 on hv-cinder-85236 Aug 09 12:30:00.194735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-f0f7b4d4-f8d6-4198-96cb-1b774c35641f req-0a79584e-4b67-4c14-823c-a36a08df8220 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044262 Aug 09 12:30:00.196773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 391/772] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:00.259942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:00.270054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b504e2f0-1358-4a31-904f-9d838fe1820d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 200 len: 1604 microversion: 2.1 time: 0.161000 Aug 09 12:30:00.271069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 382/773] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:00 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:01.298393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:01.299250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:01.306180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:01.306667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:01.307113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:01.308089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:01.308306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:01.308763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:01.323541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] HTTP exception thrown: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Request method failure captured: Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 HTTP/1.1 Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFx8hE73SBt3pj1a8OzySEdx7awttE5mUV3Eu6XFbdytmB-z-Ohp-LMfooJdfMCCe23q7tE8Qog3c80ncT3BiwitvCzEWukANA9IDl8xpNxNiQhTVV1e8r4gK0Zi8ClTzVkXE13Ge-357EtyUyrIKlQSPnQ5THfrEdWy4uL7dD3zqc Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:30:01.325232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: adadf92bd9ec48dfbb4eb5977edab923 Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:30:01.327273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '56388ec4-a642-4d87-a2a1-da60a5c0f9f5'} Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:30:01.328229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:30:01.331792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:01.334705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Returning 404 to user: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:30:01.334705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c2a5ab1-20d2-4eab-a6ae-20726bb38405 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 404 len: 111 microversion: 2.1 time: 0.033868 Aug 09 12:30:01.334705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 392/774] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:01 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:30:01.338396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-74c0e1be-6160-4270-b5bb-df01da79806e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '.version_select at 0x7f0e081118b0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:01.361606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-74c0e1be-6160-4270-b5bb-df01da79806e tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138363039" status: 202 len: 0 microversion: 2.1 time: 0.025832 Aug 09 12:30:01.361606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 383/775] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 9 12:30:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138363039 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 12:30:02.041917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-14a54839-e090-4214-babc-230d9c0c8679 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'create', calling method: .version_select at 0x7f0e0820e940>, body: {"keypair": {"name": "tempest-keypair-2118231495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRP3A07jBb8317WboRFQ+O+hzk8sSTx8kixK9ZV3vl5Ca0f3G/ePnJ7I43U/4mECgYcbr4k+cTzP84TuyYLoIY6B4VYRt1FmGnHl2UJ84H+v4J5WdcK8Lm4mJuXX9Jmaw=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:02.057588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-14a54839-e090-4214-babc-230d9c0c8679 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Getting quotas for project 47b9057e7d514e6dbe0c358cce79e61a. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:30:02.061446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-14a54839-e090-4214-babc-230d9c0c8679 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Getting quotas for user adadf92bd9ec48dfbb4eb5977edab923 and project 47b9057e7d514e6dbe0c358cce79e61a. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:30:02.084701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-14a54839-e090-4214-babc-230d9c0c8679 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047041 Aug 09 12:30:02.085288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 393/776] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:30:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:03.636842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2102671344", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c4878ee-21b0-4343-817f-c1d4db76ce5f"}], "security_groups": [{"name": "tempest-securitygroup--475347656"}], "key_name": "tempest-keypair-2118231495", "user_data": "}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:03.753521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] validate_networks() for [('3c4878ee-21b0-4343-817f-c1d4db76ce5f', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:30:04.145021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:30:04.145511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:30:04.145992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:30:04.146404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:30:04.146816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:30:04.156535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:04.157026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:04.157461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:04.158186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:04.158641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:04.159069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:04.177482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Getting quotas for project 47b9057e7d514e6dbe0c358cce79e61a. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:30:04.181707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Getting quotas for user adadf92bd9ec48dfbb4eb5977edab923 and project 47b9057e7d514e6dbe0c358cce79e61a. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:30:04.193747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:30:04.195972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:30:04.246184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a3c90b93-08f0-4d18-bac6-30473fbffb99 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.614283 Aug 09 12:30:04.247215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 384/777] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:30:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 12:30:04.258770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2298050c-427c-4a31-8e8b-83f6272f47bf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:04.259365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2298050c-427c-4a31-8e8b-83f6272f47bf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:04.313982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2298050c-427c-4a31-8e8b-83f6272f47bf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:04.321162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2298050c-427c-4a31-8e8b-83f6272f47bf tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1238 microversion: 2.1 time: 0.066928 Aug 09 12:30:04.334985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 394/778] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:04 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:05.255695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:05.256323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:05.264184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:05.264748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:05.265269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:05.266122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:05.267534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:05.268177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:05.272848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:05.296982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:30:05.343819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:05.344481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:05.361443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:05.362518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:05.364289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:05.365234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:05.365881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:05.369959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:05.411518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7bf43aa7-0d1d-4798-b304-75a91215947d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 204 len: 0 microversion: 2.1 time: 0.159727 Aug 09 12:30:05.413849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 385/779] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:30:05 2022] DELETE /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:30:05.425426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:05.426131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:05.432567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:05.433333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:05.433764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:05.434654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:05.435168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:05.435592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:05.760336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:05.769115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3f1e979f-f332-4431-a03c-8cd1cca7afb6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1298 microversion: 2.1 time: 0.429912 Aug 09 12:30:05.769676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 395/780] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:05 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1298 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:30:05.865448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:05.874707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2da69ccb-71e3-4ca3-9f77-4cecc11ac946 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1579 microversion: 2.1 time: 0.454885 Aug 09 12:30:05.875365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 386/781] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:05 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1579 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:06.790320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:06.791153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:06.799272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:06.799849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:06.800371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:06.801360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:06.802091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:06.802856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:06.899715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:06.906034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:06.911427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:06.914325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2310112-1ec5-425a-b12a-a2c7c54fbec4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1296 microversion: 2.1 time: 0.127789 Aug 09 12:30:06.915240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 396/782] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:06 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:06.941012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:06.941486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:06.941917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:06.942608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:06.943058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:06.943471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:07.235689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:07.243758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a186d65-caa9-40fa-b48f-bc96fd9dd191 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1579 microversion: 2.1 time: 0.350537 Aug 09 12:30:07.244313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 387/783] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:06 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1579 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:07.935953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:07.936654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:07.944013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:07.945125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:07.945726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:07.946597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:07.947198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:07.948038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:08.179330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:08.197121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f80542c0-41b0-4706-878d-5c0e817e1f21 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.256979 Aug 09 12:30:08.199731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 397/784] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:07 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:08.267349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:08.268006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:08.275343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-665f30c1-b22e-402c-a356-ea5b10139170 req-69753beb-0f34-47f6-9996-06e9dbc430bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c51fe9-e024-4c1b-a62f-605682cf8e14", "tag": "f4e3222a-9ec3-4f08-9ef5-8f0b022ad30a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:08.277175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:08.277669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:08.279329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:08.281822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:08.283595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:08.284317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:08.287416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-665f30c1-b22e-402c-a356-ea5b10139170 req-69753beb-0f34-47f6-9996-06e9dbc430bf service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:08.288114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-665f30c1-b22e-402c-a356-ea5b10139170 req-69753beb-0f34-47f6-9996-06e9dbc430bf service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:08.300408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-665f30c1-b22e-402c-a356-ea5b10139170 req-69753beb-0f34-47f6-9996-06e9dbc430bf service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:08.320143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-665f30c1-b22e-402c-a356-ea5b10139170 req-69753beb-0f34-47f6-9996-06e9dbc430bf service nova] Creating event network-changed:f4e3222a-9ec3-4f08-9ef5-8f0b022ad30a for instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 on hv-cinder-85236 Aug 09 12:30:08.328880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-665f30c1-b22e-402c-a356-ea5b10139170 req-69753beb-0f34-47f6-9996-06e9dbc430bf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056971 Aug 09 12:30:08.330677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 398/785] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:30:08.416014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:08.425211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d1baa5d-9244-488a-8b5e-a3ca5bbe2426 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1511 microversion: 2.1 time: 0.162194 Aug 09 12:30:08.426708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 388/786] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:08 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:08.529877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-0159177e-ee22-48a4-9a57-0d21faed44ed req-a48317b8-6cf1-4260-912b-74026963465d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c88f62f-d964-413d-a4be-e4f7341cabe9", "name": "network-vif-deleted", "tag": "bc8f15c0-f198-4c6e-a2e3-e05889e916b2"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:08.545142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0159177e-ee22-48a4-9a57-0d21faed44ed req-a48317b8-6cf1-4260-912b-74026963465d service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:08.545867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0159177e-ee22-48a4-9a57-0d21faed44ed req-a48317b8-6cf1-4260-912b-74026963465d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:08.546522 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-0159177e-ee22-48a4-9a57-0d21faed44ed req-a48317b8-6cf1-4260-912b-74026963465d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:08.558023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-0159177e-ee22-48a4-9a57-0d21faed44ed req-a48317b8-6cf1-4260-912b-74026963465d service nova] Creating event network-vif-deleted:bc8f15c0-f198-4c6e-a2e3-e05889e916b2 for instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 on hv-cinder-85236 Aug 09 12:30:08.562986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-0159177e-ee22-48a4-9a57-0d21faed44ed req-a48317b8-6cf1-4260-912b-74026963465d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037145 Aug 09 12:30:08.563620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 399/787] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:09.218068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:09.219032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:09.227008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:09.227868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:09.228115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:09.229006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:09.229607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:09.230198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:09.426137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:09.433673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-794f1d4f-ac63-43e1-94a3-f32852c75cad tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.219839 Aug 09 12:30:09.434244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 389/788] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:09 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:09.448286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:09.449007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:09.455685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:09.456162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:09.456645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:09.457327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:09.457773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:09.458184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:09.496091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:09.497174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:09.497768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:09.498394 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lazy-loading 'fault' on Instance uuid 0c88f62f-d964-413d-a4be-e4f7341cabe9 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:30:09.595159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:09.607440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2b8155c-60f6-48b6-bd18-402303ef4072 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 200 len: 1230 microversion: 2.1 time: 0.163638 Aug 09 12:30:09.621043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 400/789] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:09 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 1230 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:10.457066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:10.457770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:10.466120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:10.466729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:10.467270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:10.468097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:10.468582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:10.468968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:10.623120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:10.629947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:10.630765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:10.631277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-12ae6c07-6096-448a-83e8-bbe8ff6c1a70 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.179261 Aug 09 12:30:10.640994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 390/790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:10 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:10.641121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:10.641121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:10.641121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:10.641121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:10.641477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:10.641477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:10.655109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] HTTP exception thrown: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Request method failure captured: Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 HTTP/1.1 Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lJmmNztbTde0_SSYDZkHlOlKKRyyH8xhTaPeEQcl0zDncwHtVob8O0nOEllX3q1YoFPpndW5EnoSCehyS33kaBqlrir--u2jwnA0Jr1VUAhqdc_8iOKakjDdrGfYSnsSmWxkLAF61j0-PUaJ5bx67y-qVlROspImLwOZWLjxo_KN1w Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 602ad89c70da4ace9856766be19815a5 Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-1825304612 Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:30:10.657252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/602ad89c70da4ace9856766be19815a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/602ad89c70da4ace9856766be19815a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_602ad89c70da4ace9856766be19815a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/602ad89c70da4ace9856766be19815a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-1825304612 Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 602ad89c70da4ace9856766be19815a5 Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-1825304612 Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-1825304612-project Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 50fa6727271142eba979bb4562a2b853 Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-1825304612-project Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 12:30:10.658941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '0c88f62f-d964-413d-a4be-e4f7341cabe9'} Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:30:10.659825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 12:30:10.661135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:10.662317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Returning 404 to user: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:30:10.662317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7b91b7c-dd40-4a0d-a8ab-71b77e4240ae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 404 len: 111 microversion: 2.1 time: 0.032741 Aug 09 12:30:10.662317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 401/791] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:10 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:30:10.764845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1128092079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898829135", "security_groups": [{"name": "tempest-secgroup-smoke-1174931768"}], "block_device_mapping_v2": [{"uuid": "127acce2-190f-4b63-b431-046f9d93a2f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b924274-f01a-4354-a302-f155f90252c3"}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:10.881347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] validate_networks() for [('6b924274-f01a-4354-a302-f155f90252c3', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:30:11.269284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:30:11.269707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:30:11.270180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:30:11.270589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:30:11.270999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:30:11.279961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:11.280471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:11.280907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:11.281634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:11.282086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:11.282509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:11.300754 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Getting quotas for project 602ad89c70da4ace9856766be19815a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:30:11.304905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Getting quotas for user 50fa6727271142eba979bb4562a2b853 and project 602ad89c70da4ace9856766be19815a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:30:11.364037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:30:11.366150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='127acce2-190f-4b63-b431-046f9d93a2f7',volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:30:11.514243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f52003e9-afc8-479a-a02a-d5b90272d31b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753675 Aug 09 12:30:11.521867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 391/792] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:30:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:30:11.526897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-55a2f923-4090-437d-92b9-d15169099e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:11.527498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-55a2f923-4090-437d-92b9-d15169099e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:11.581226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-55a2f923-4090-437d-92b9-d15169099e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:11.588098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-55a2f923-4090-437d-92b9-d15169099e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1094 microversion: 2.1 time: 0.065249 Aug 09 12:30:11.588700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 402/793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:11 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:11.654269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:11.655025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:11.661738 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:11.662356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:11.662879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:11.663746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:11.664295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:11.665011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:11.805914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:11.813522 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffed230f-b88b-46fb-a781-cde38326542f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.164153 Aug 09 12:30:11.825127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 392/794] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:11 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:12.609734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:12.610326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:12.617935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:12.618419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:12.618849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:12.619552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:12.620001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:12.620418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:12.686435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:12.694325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a28a174-b61b-40fa-9437-e16d42c41b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1144 microversion: 2.1 time: 0.088961 Aug 09 12:30:12.694886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 403/795] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:12 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:12.834501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:12.835106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:12.842216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:12.842907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:12.843368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:12.844047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:12.844550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:12.844967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:12.984898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:12.993073 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-148040ff-b198-4064-a03f-e8fa0ab0676d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.162245 Aug 09 12:30:12.993536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 393/796] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:12 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:13.717792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:13.718371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:13.726891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:13.727579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:13.728226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:13.728965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:13.729417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:13.729860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:13.794212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:13.802184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ddada47c-c9d9-48f7-93c6-048e7bca3b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1144 microversion: 2.1 time: 0.090542 Aug 09 12:30:13.802746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 404/797] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:13 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:14.013797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:14.014377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:14.021550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:14.022030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:14.022462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:14.023155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:14.023604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:14.024020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:14.170059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:14.181620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a46eb460-3bb6-46ef-8425-18774f3396ae tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.171512 Aug 09 12:30:14.182380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 394/798] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:14 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:14.826549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:14.827610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:14.835692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:14.836178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:14.836648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:14.837344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:14.837800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:14.838221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:14.901279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:14.913168 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca2737b5-02f6-4aae-8d44-419be2316d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1144 microversion: 2.1 time: 0.092825 Aug 09 12:30:14.913924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 405/799] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:14 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:15.204875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:15.205395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:15.212213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:15.212740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:15.213208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:15.213894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:15.214352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:15.214849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:15.354064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:15.361933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-99c644e6-5fe7-4569-ac3b-83a3959ac99f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.161119 Aug 09 12:30:15.362620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 395/800] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:15 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:15.934472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:15.935071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:15.943676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:15.944158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:15.944628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:15.945319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:15.945765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:15.946183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:16.013565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:16.021885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-abdd98fd-191a-4652-81a9-3fd783415083 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1144 microversion: 2.1 time: 0.091256 Aug 09 12:30:16.035239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 406/801] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:15 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1144 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:16.387694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:16.388359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:16.394938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:16.395420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:16.395843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:16.396554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:16.396999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:16.397408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:16.635073 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:16.645175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01389e00-522c-4b37-a5cc-552269a428ed tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.261027 Aug 09 12:30:16.645682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 396/802] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:16 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:30:17.043674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:17.044275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:17.051164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:17.051925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:17.052359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:17.053054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:17.053502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:17.053922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:17.117442 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:17.128587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bed93ce5-ef21-436c-a099-3568b3c1ee5d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1192 microversion: 2.1 time: 0.089300 Aug 09 12:30:17.129837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 407/803] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:17 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:17.666551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:17.667246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:17.673678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:17.674147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:17.674579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:17.675269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:17.675726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:17.676298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:17.829607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:17.838195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9a7dbe4b-c240-492c-bfda-e38fc9670d5f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.175844 Aug 09 12:30:17.838866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 397/804] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:17 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:18.151303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:18.152211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:18.162591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:18.163354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:18.163949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:18.165155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:18.165995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:18.166573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:18.182160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-54ac59fb-bfe8-4201-b1a9-9bfd921e011f req-1b71475e-5979-4c36-bf01-3c54e1028cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c51fe9-e024-4c1b-a62f-605682cf8e14", "name": "network-vif-plugged", "status": "completed", "tag": "f4e3222a-9ec3-4f08-9ef5-8f0b022ad30a"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:18.203867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-54ac59fb-bfe8-4201-b1a9-9bfd921e011f req-1b71475e-5979-4c36-bf01-3c54e1028cfc service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:18.204739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-54ac59fb-bfe8-4201-b1a9-9bfd921e011f req-1b71475e-5979-4c36-bf01-3c54e1028cfc service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:18.205487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-54ac59fb-bfe8-4201-b1a9-9bfd921e011f req-1b71475e-5979-4c36-bf01-3c54e1028cfc service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:18.252325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-54ac59fb-bfe8-4201-b1a9-9bfd921e011f req-1b71475e-5979-4c36-bf01-3c54e1028cfc service nova] Creating event network-vif-plugged:f4e3222a-9ec3-4f08-9ef5-8f0b022ad30a for instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 on hv-cinder-85236 Aug 09 12:30:18.273052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-54ac59fb-bfe8-4201-b1a9-9bfd921e011f req-1b71475e-5979-4c36-bf01-3c54e1028cfc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094213 Aug 09 12:30:18.276800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 398/805] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:18.354349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:18.364201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d7a08a2-07cf-4eb6-98d9-04312974ddf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1278 microversion: 2.1 time: 0.215551 Aug 09 12:30:18.365817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 408/806] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:18 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:18.866659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-4b1b6995-c202-4bf2-92db-100c0f954b5a req-ac369033-d6ca-4307-9a7f-9ec9c24b9f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeda6f80-e084-4b10-ae40-27df258a9d91", "tag": "ce375374-7026-4900-8816-8278e724722e"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:18.874413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:18.875154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:18.886293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:18.886479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:18.886880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:18.888112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:18.888954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:18.889552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:18.891610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4b1b6995-c202-4bf2-92db-100c0f954b5a req-ac369033-d6ca-4307-9a7f-9ec9c24b9f1b service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:18.892254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4b1b6995-c202-4bf2-92db-100c0f954b5a req-ac369033-d6ca-4307-9a7f-9ec9c24b9f1b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:18.892850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4b1b6995-c202-4bf2-92db-100c0f954b5a req-ac369033-d6ca-4307-9a7f-9ec9c24b9f1b service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:18.912061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-4b1b6995-c202-4bf2-92db-100c0f954b5a req-ac369033-d6ca-4307-9a7f-9ec9c24b9f1b service nova] Creating event network-changed:ce375374-7026-4900-8816-8278e724722e for instance eeda6f80-e084-4b10-ae40-27df258a9d91 on hv-cinder-85236 Aug 09 12:30:18.917421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-4b1b6995-c202-4bf2-92db-100c0f954b5a req-ac369033-d6ca-4307-9a7f-9ec9c24b9f1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058594 Aug 09 12:30:18.918265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 409/807] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:19.042469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:19.052564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4d3c56b-b573-415f-8cb8-6ca0cc1e3393 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.194286 Aug 09 12:30:19.053202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 399/808] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:18 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:19.389793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:19.390464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:19.398106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:19.398558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:19.398971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:19.399653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:19.400094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:19.400548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:19.571428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:19.579879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2ef86d1-83ce-4c0f-9b9d-eadb7854d5ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.194517 Aug 09 12:30:19.580686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 410/809] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:19 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:20.077701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:20.078312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:20.085214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:20.085725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:20.086155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:20.086855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:20.087338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:20.087755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:20.233691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:20.241811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5b5c7ae8-8350-4ddf-ac02-7057c2c4b093 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1363 microversion: 2.1 time: 0.171111 Aug 09 12:30:20.255473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 400/810] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:20 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:20.601509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:20.602093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:20.608554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:20.609586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:20.610209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:20.610940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:20.611573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:20.611989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:20.751434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:20.765619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9042a862-3c14-47ab-bef0-726bccdf6832 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.167805 Aug 09 12:30:20.769474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 411/811] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:20 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:21.263134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:21.263741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:21.270331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:21.270813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:21.271253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:21.271946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:21.272421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:21.272848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:21.290872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=4 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:21.291650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:21.311082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=12 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:21.408019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:21.416317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9912e6a4-f3c7-4632-a930-544f09bc307f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1548 microversion: 2.1 time: 0.156905 Aug 09 12:30:21.417011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 401/812] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:21 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:21.436444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:21.436971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:21.443198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:21.443680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:21.444104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:21.444964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:21.445248 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:21.445956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:21.527921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73223fcc-2032-463b-be8c-64db9158d10b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095308 Aug 09 12:30:21.528667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 412/813] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 9 12:30:21 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:21.791365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:21.792209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:21.799528 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:21.800614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:21.801220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:21.802294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:21.802940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:21.803368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:21.943502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:21.951635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3d9896e7-28ff-4191-99d2-4390e3eaa106 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.164311 Aug 09 12:30:21.952227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 402/814] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:21 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:30:22.495514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=8 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:22.501097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-74d3945a-fc60-4240-88e6-4e5733863c41 req-53058d1f-ca85-4795-96e3-9f7dcbfe1e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c51fe9-e024-4c1b-a62f-605682cf8e14", "tag": "f4e3222a-9ec3-4f08-9ef5-8f0b022ad30a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:22.510359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-74d3945a-fc60-4240-88e6-4e5733863c41 req-53058d1f-ca85-4795-96e3-9f7dcbfe1e25 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:22.510831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-74d3945a-fc60-4240-88e6-4e5733863c41 req-53058d1f-ca85-4795-96e3-9f7dcbfe1e25 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:22.511253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-74d3945a-fc60-4240-88e6-4e5733863c41 req-53058d1f-ca85-4795-96e3-9f7dcbfe1e25 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:22.524940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-74d3945a-fc60-4240-88e6-4e5733863c41 req-53058d1f-ca85-4795-96e3-9f7dcbfe1e25 service nova] Creating event network-changed:f4e3222a-9ec3-4f08-9ef5-8f0b022ad30a for instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 on hv-cinder-85236 Aug 09 12:30:22.530131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-74d3945a-fc60-4240-88e6-4e5733863c41 req-53058d1f-ca85-4795-96e3-9f7dcbfe1e25 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035268 Aug 09 12:30:22.531039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 413/815] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:22.973352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:22.974130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:22.990364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:22.990859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:22.991294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:22.992118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:22.992606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:22.993031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:23.236309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:23.249188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-559236ac-aef1-4a20-9444-5ae603f3e7a9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.280608 Aug 09 12:30:23.249899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 403/816] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:22 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:24.270307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:24.271114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:24.277831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:24.278353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:24.278886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:24.279579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:24.280029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:24.280483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:24.419116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:24.427411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-026fe360-e03e-469d-acf3-269b44bd903e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.161447 Aug 09 12:30:24.428063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 414/817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:24 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:25.448023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:25.449364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:25.456497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:25.456994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:25.457426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:25.458127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:25.458576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:25.459142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:25.753194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:25.761439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-63cc8873-b403-42fd-8bdc-9969182e0fc4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.317268 Aug 09 12:30:25.774947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 404/818] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:25 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:26.783752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:26.785052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:26.791433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:26.791747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:26.792464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:26.793197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:26.793651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:26.794242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:26.814115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:27.023350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:27.036673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fe7b10f1-7371-48c7-a31c-88223c1bd08d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.257629 Aug 09 12:30:27.037538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 415/819] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:26 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:28.059469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:28.061282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:28.072980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:28.076354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:28.078113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:28.079513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:28.081094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:28.081719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:28.082326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:28.337462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:28.349423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c9b9448e-9984-45b9-a6b0-3f31070c9b83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.294407 Aug 09 12:30:28.363622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 405/820] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:28 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:29.370984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:29.371970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:29.378007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:29.380322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:29.380902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:29.381343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:29.382086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:29.382513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:29.382972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:29.564850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:29.574494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c254223-da2d-46ef-8bda-3238da73516c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.207751 Aug 09 12:30:29.578642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 416/821] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:29 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:30.595714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:30.597425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:30.614660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:30.615431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:30.616191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:30.617346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:30.618105 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:30.618862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:30.818374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:30.827590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-131f4a85-cbfe-452a-8335-4abbb21f9230 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.236212 Aug 09 12:30:30.828812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 406/822] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:30 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:31.850112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:31.850868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:31.864251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:31.865816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:31.866365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:31.869339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:31.870856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:31.873905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:32.299035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:32.313297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73baab69-e615-4be6-ad9e-a974b6ef3bdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.467603 Aug 09 12:30:32.313985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 417/823] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:31 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:32.668751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-30799cc4-ed0b-48aa-849a-1f00cc930256 req-b5f04d95-ed02-48c4-b36a-f3eab85e336f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeda6f80-e084-4b10-ae40-27df258a9d91", "name": "network-vif-plugged", "status": "completed", "tag": "ce375374-7026-4900-8816-8278e724722e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:32.686904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-30799cc4-ed0b-48aa-849a-1f00cc930256 req-b5f04d95-ed02-48c4-b36a-f3eab85e336f service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:32.687713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-30799cc4-ed0b-48aa-849a-1f00cc930256 req-b5f04d95-ed02-48c4-b36a-f3eab85e336f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:32.688349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-30799cc4-ed0b-48aa-849a-1f00cc930256 req-b5f04d95-ed02-48c4-b36a-f3eab85e336f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:32.713271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-30799cc4-ed0b-48aa-849a-1f00cc930256 req-b5f04d95-ed02-48c4-b36a-f3eab85e336f service nova] Creating event network-vif-plugged:ce375374-7026-4900-8816-8278e724722e for instance eeda6f80-e084-4b10-ae40-27df258a9d91 on hv-cinder-85236 Aug 09 12:30:32.733707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-30799cc4-ed0b-48aa-849a-1f00cc930256 req-b5f04d95-ed02-48c4-b36a-f3eab85e336f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069562 Aug 09 12:30:32.744304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 407/824] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:33.335090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:33.336262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:33.349792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:33.350284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:33.351154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:33.352062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:33.354641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:33.355301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:33.589094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:33.600032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a30393a6-f468-48a8-9da1-fd138ac6b566 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.266159 Aug 09 12:30:33.601705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 418/825] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:33 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:34.624887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:34.625574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:34.640814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:34.641653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:34.642415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:34.643412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:34.643979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:34.644565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:34.813788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:34.825342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4ae348e3-c76d-4058-bf9a-24d78ca6f9e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1266 microversion: 2.1 time: 0.206306 Aug 09 12:30:34.826242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 408/826] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:34 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:35.049387 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-893219e1-2f02-4551-9b54-4c1bbf370062 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Action: 'create', calling method: .version_select at 0x7f0e083245e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1775770115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6d+thoNFuFhd7Sqm+xrjSwPoXwjSIyHLGyuMbfBsLwkUK9+eBvIs4edwYB59x0HRlUB6+qnHsQbb9tpyc4GGFGumCDxmwj/DuNH7VrHmr5W7tNgCdKOWdGlRH5iomTjQ=="}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:35.073007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-893219e1-2f02-4551-9b54-4c1bbf370062 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Getting quotas for project bc3caeb344224a6b9ead2052d0b44909. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:30:35.077554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-893219e1-2f02-4551-9b54-4c1bbf370062 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Getting quotas for user 72593249ee4843e9bb3ae413bfccf8b7 and project bc3caeb344224a6b9ead2052d0b44909. Resources: {'key_pairs'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:30:35.103082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-893219e1-2f02-4551-9b54-4c1bbf370062 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.296137 Aug 09 12:30:35.103704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 419/827] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:30:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:35.855621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:35.856409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:35.871805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:35.873054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:35.873573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:35.874163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:35.876490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:35.877111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:36.145384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:36.154830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c037ed3-9fcd-4c3d-a1a6-7e4f3b547419 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1454 microversion: 2.1 time: 0.312218 Aug 09 12:30:36.155424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 409/828] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:35 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1454 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:36.176845 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:36.178363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:36.189295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:36.190194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:36.190816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:36.191534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:36.191988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:36.192436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:36.368489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:36.376577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9731879f-999b-463b-b039-a187db096b0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1454 microversion: 2.1 time: 0.204175 Aug 09 12:30:36.378406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 420/829] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:36 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:30:38.704941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-58d2c6cb-03c0-4f73-96f3-107fbff974ba req-fa99ab57-030e-449d-9a44-710c9a3bac90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeda6f80-e084-4b10-ae40-27df258a9d91", "tag": "ce375374-7026-4900-8816-8278e724722e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:38.717896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-58d2c6cb-03c0-4f73-96f3-107fbff974ba req-fa99ab57-030e-449d-9a44-710c9a3bac90 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:38.717896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-58d2c6cb-03c0-4f73-96f3-107fbff974ba req-fa99ab57-030e-449d-9a44-710c9a3bac90 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:38.717896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-58d2c6cb-03c0-4f73-96f3-107fbff974ba req-fa99ab57-030e-449d-9a44-710c9a3bac90 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:38.730958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-58d2c6cb-03c0-4f73-96f3-107fbff974ba req-fa99ab57-030e-449d-9a44-710c9a3bac90 service nova] Creating event network-changed:ce375374-7026-4900-8816-8278e724722e for instance eeda6f80-e084-4b10-ae40-27df258a9d91 on hv-cinder-85236 Aug 09 12:30:38.742146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-58d2c6cb-03c0-4f73-96f3-107fbff974ba req-fa99ab57-030e-449d-9a44-710c9a3bac90 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040018 Aug 09 12:30:38.746272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 410/830] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:45.846120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:45.847214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:45.848655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=4 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:45.854831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:45.855312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:45.855735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:45.856459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:45.856903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:45.857312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:45.881153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fce68699-bf5a-4e4f-81e7-479037355331 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/ips" status: 200 len: 150 microversion: 2.1 time: 0.039263 Aug 09 12:30:45.882037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 421/831] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:30:45 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:48.303423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68383e97-94f5-4673-a09b-d1833807d4bc"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:48.305891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:48.312702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:48.313373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:48.313985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:48.315806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:48.315806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:48.315806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:48.609545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f502c536-127f-4adf-a3ae-08f58aab8c59 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311271 Aug 09 12:30:48.610196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 411/832] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:30:48 2022] POST /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:57.274319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68383e97-94f5-4673-a09b-d1833807d4bc"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:30:57.276722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:57.279218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:57.279924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=30 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:57.285403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:57.285888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:57.286347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:57.287038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:57.287488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:57.287907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:57.371271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Invalid volume: volume 68383e97-94f5-4673-a09b-d1833807d4bc is already attached to instances: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments HTTP/1.1 Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 74 Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:30:57.373101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {"volumeAttachment": {"volumeId": "68383e97-94f5-4673-a09b-d1833807d4bc"}} Aug 09 12:30:57.374840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Invalid volume: volume 68383e97-94f5-4673-a09b-d1833807d4bc is already attached to instances: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '8ca3852b-60ed-4fdd-92fc-ff09275d22f7', 'body': {'volumeAttachment': {'volumeId': '68383e97-94f5-4673-a09b-d1833807d4bc'}}} Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 68383e97-94f5-4673-a09b-d1833807d4bc is already attached to instances: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:57.376196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 68383e97-94f5-4673-a09b-d1833807d4bc is already attached to instances: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:30:57.378399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:30:57.380399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:30:57.380399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:30:57.380399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:30:57.380399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 68383e97-94f5-4673-a09b-d1833807d4bc is already attached to instances: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 Aug 09 12:30:57.380399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:30:57.380399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 400 to user: Invalid volume: volume 68383e97-94f5-4673-a09b-d1833807d4bc is already attached to instances: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:30:57.380399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9112476-62c8-494e-98c5-8854d843c799 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104403 Aug 09 12:30:57.380399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 422/833] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:30:57 2022] POST /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:30:57.446948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:57.447561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:57.454159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:57.454651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:57.455098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:57.455786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:57.456228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:57.456671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:57.460591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:57.699930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lazy-loading 'services' on Instance uuid 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:30:57.776293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-553405a2-e8b1-4b12-b72e-2fc170fc92a1 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments/68383e97-94f5-4673-a09b-d1833807d4bc" status: 202 len: 0 microversion: 2.1 time: 0.333953 Aug 09 12:30:57.776934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 412/834] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:30:57 2022] DELETE /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments/68383e97-94f5-4673-a09b-d1833807d4bc => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:30:57.786535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:57.788807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:57.795905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:57.796405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:57.796836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:57.798189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:57.798675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:57.799193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:57.829319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4984ba66-3c41-4dd3-bcec-7d1c7c246c7e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Aug 09 12:30:57.829860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 423/835] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:30:57 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:30:58.843417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:58.845781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:58.847779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=16 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:58.853688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:58.854172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:58.854623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:58.855318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:58.855766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:58.856186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:58.887244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4f5fd9be-53bb-4739-b4e4-295017325b3c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048726 Aug 09 12:30:58.888052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 413/836] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:30:58 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:30:58.954662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:58.955185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:58.962056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:58.962536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:58.962977 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:58.963652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:58.964101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:58.964554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:58.990521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:30:59.071150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-139888be-967c-4dae-9c02-5bebbc7d5ffa tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 204 len: 0 microversion: 2.1 time: 0.120034 Aug 09 12:30:59.071654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 424/837] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:30:58 2022] DELETE /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:30:59.080358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:30:59.081004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:30:59.087298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:59.087783 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:59.088227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:59.089031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:30:59.089489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:30:59.089916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:30:59.226234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:30:59.234426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2b99f947-c964-46e7-8702-684fdc7f1719 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1682 microversion: 2.1 time: 0.157939 Aug 09 12:30:59.235004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 414/838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:30:59 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:00.261887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:00.263023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:00.272254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:00.272765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:00.273198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:00.273882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:00.274328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:00.274749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:00.418158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:00.426599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13b61257-181e-4371-b3f9-a4c45f38015e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1682 microversion: 2.1 time: 0.171880 Aug 09 12:31:00.427167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 425/839] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:00 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:00.622833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-739206295", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1775770115", "security_groups": [{"name": "tempest-secgroup-smoke-303256903"}], "networks": [{"uuid": "3f409414-aa91-466c-a04c-cd348f88359e"}], "block_device_mapping_v2": [{"uuid": "a89e0614-d4ea-4647-bfdc-45e29f13aaad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:00.898384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] validate_networks() for [('3f409414-aa91-466c-a04c-cd348f88359e', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:31:01.289432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:31:01.290050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:31:01.290759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:31:01.291347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:31:01.292004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:31:01.306205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:01.306955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:01.307490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:01.308557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:01.309273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:01.309969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:01.329160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Getting quotas for project bc3caeb344224a6b9ead2052d0b44909. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:31:01.333672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Getting quotas for user 72593249ee4843e9bb3ae413bfccf8b7 and project bc3caeb344224a6b9ead2052d0b44909. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:31:01.399893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:31:01.402627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a89e0614-d4ea-4647-bfdc-45e29f13aaad',volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:31:01.447614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:01.448115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:01.455474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:01.456141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:01.456701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:01.457399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:01.457832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:01.458251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:01.552901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b0f4a4b1-a13c-4539-ad04-6958544c96eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.934227 Aug 09 12:31:01.560205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 415/840] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:31:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:31:01.566002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b2b49a30-0be6-45ae-bbdc-21c467e81805 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:01.567172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b2b49a30-0be6-45ae-bbdc-21c467e81805 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:01.637124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b2b49a30-0be6-45ae-bbdc-21c467e81805 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:01.649376 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b2b49a30-0be6-45ae-bbdc-21c467e81805 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1088 microversion: 2.1 time: 0.087790 Aug 09 12:31:01.662328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 416/841] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:01 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1088 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:01.662696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:01.667518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92dd3a51-6880-43fc-9972-5f07d02c1f4d tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1682 microversion: 2.1 time: 0.223908 Aug 09 12:31:01.668102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 426/842] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:01 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1682 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:02.275881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-b76eff7c-2d62-423f-aa18-8641fc703255 req-ab9cddb0-eb30-42ae-b426-dbeb24bd8494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca3852b-60ed-4fdd-92fc-ff09275d22f7", "name": "network-vif-deleted", "tag": "0ac78168-8bf6-420f-9206-2d253e163fdc"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:02.290901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b76eff7c-2d62-423f-aa18-8641fc703255 req-ab9cddb0-eb30-42ae-b426-dbeb24bd8494 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:02.291474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b76eff7c-2d62-423f-aa18-8641fc703255 req-ab9cddb0-eb30-42ae-b426-dbeb24bd8494 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:02.292125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-b76eff7c-2d62-423f-aa18-8641fc703255 req-ab9cddb0-eb30-42ae-b426-dbeb24bd8494 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:02.304640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-b76eff7c-2d62-423f-aa18-8641fc703255 req-ab9cddb0-eb30-42ae-b426-dbeb24bd8494 service nova] Creating event network-vif-deleted:0ac78168-8bf6-420f-9206-2d253e163fdc for instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 on hv-cinder-85236 Aug 09 12:31:02.310037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-b76eff7c-2d62-423f-aa18-8641fc703255 req-ab9cddb0-eb30-42ae-b426-dbeb24bd8494 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044239 Aug 09 12:31:02.311273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 417/843] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:31:02.671243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:02.671934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:02.679286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:02.679775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:02.680360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:02.681148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:02.681600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:02.682019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:02.690236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:02.691529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:02.698960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:02.699511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:02.700287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:02.701512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:02.702182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:02.702810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:02.737123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:02.737945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:02.738608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:02.739263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lazy-loading 'fault' on Instance uuid 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:31:02.774628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:02.790707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c78e5544-41ca-456c-a5f0-de84a94c3a6a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1186 microversion: 2.1 time: 0.124256 Aug 09 12:31:02.791689 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 427/844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:02 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1186 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:02.801824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:02.810309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bdc63bee-c944-42d0-954a-4c38dc9fd497 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 200 len: 1331 microversion: 2.1 time: 0.124852 Aug 09 12:31:02.810930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 418/845] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:02 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:31:03.817808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:03.818411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:03.825098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:03.825604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:03.826025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:03.826956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:03.827422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:03.827849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:03.831370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:03.831976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:03.838816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:03.839308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:03.839727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:03.840485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:03.841128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:03.841548 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:03.855838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 HTTP/1.1 Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:31:03.857657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:31:03.859306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '8ca3852b-60ed-4fdd-92fc-ff09275d22f7'} Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:31:03.861421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:31:03.862977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:31:03.864351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:31:03.864351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-50f7d0d0-9919-4ed5-ae87-e1a98035e2b3 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 404 len: 111 microversion: 2.1 time: 0.031734 Aug 09 12:31:03.864351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 419/846] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:03 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:31:03.876612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5e9191b4-23a6-4e62-9153-f5146f89231c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '.version_select at 0x7f0e080b9f70>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:03.898265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:03.903210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5e9191b4-23a6-4e62-9153-f5146f89231c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558414930" status: 202 len: 0 microversion: 2.1 time: 0.030330 Aug 09 12:31:03.904170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 420/847] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 9 12:31:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1558414930 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:31:03.906969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d0767fba-3ba3-4f6d-a328-e5756ec32cf4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1204 microversion: 2.1 time: 0.095846 Aug 09 12:31:03.920203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 428/848] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:03 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:04.606733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1de788a9-f3be-471c-a6c7-9ce4a859c10a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: .version_select at 0x7f0e080f8160>, body: {"keypair": {"name": "tempest-keypair-178459495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkcsusxD6hFe3OCAxo1HEsIZKLQoo+fGngZho+QW0XHO0GjqfemyGygmLIskaMGpQxUzBhV7Eb/T9Zh3EKM+t3aFtRkVAd6LKqzl2zcwJ5WpNVhI4RluCBORyvsqINNvA=="}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:04.623889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-1de788a9-f3be-471c-a6c7-9ce4a859c10a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for project cffa9ae943de44bc8264914e39c80cfa. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:31:04.627651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-1de788a9-f3be-471c-a6c7-9ce4a859c10a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for user c8982b93df5744bbbdeb7a956df06502 and project cffa9ae943de44bc8264914e39c80cfa. Resources: {'key_pairs'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:31:04.651210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1de788a9-f3be-471c-a6c7-9ce4a859c10a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048401 Aug 09 12:31:04.651803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 421/849] 10.222.0.60 () {60 vars in 1159 bytes} [Tue Aug 9 12:31:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:31:04.928560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:04.929163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:04.935621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:04.936135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:04.936603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:04.937296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:04.937743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:04.938178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:04.991428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-c7c09f99-29bc-4899-9161-34a0d4c9dd2d req-8cc111ff-0376-4c71-a40c-1354b253d10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a368964e-2b12-4ec7-a757-4cf2796910ab", "tag": "547a0884-98cf-4ddd-b43b-9c8ffe94c31a"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:05.004094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c7c09f99-29bc-4899-9161-34a0d4c9dd2d req-8cc111ff-0376-4c71-a40c-1354b253d10c service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:05.004828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c7c09f99-29bc-4899-9161-34a0d4c9dd2d req-8cc111ff-0376-4c71-a40c-1354b253d10c service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:05.005509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c7c09f99-29bc-4899-9161-34a0d4c9dd2d req-8cc111ff-0376-4c71-a40c-1354b253d10c service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:05.017298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-c7c09f99-29bc-4899-9161-34a0d4c9dd2d req-8cc111ff-0376-4c71-a40c-1354b253d10c service nova] Creating event network-changed:547a0884-98cf-4ddd-b43b-9c8ffe94c31a for instance a368964e-2b12-4ec7-a757-4cf2796910ab on hv-cinder-85236 Aug 09 12:31:05.038379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-c7c09f99-29bc-4899-9161-34a0d4c9dd2d req-8cc111ff-0376-4c71-a40c-1354b253d10c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050919 Aug 09 12:31:05.038379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 422/850] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:31:05.084425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:05.091971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58a7820c-a53c-4a7e-863a-43beebb9e1d6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.167768 Aug 09 12:31:05.092566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 429/851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:04 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:06.114807 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:06.115501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:06.122723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:06.123212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:06.123648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:06.124344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:06.124818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:06.125251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:06.187204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1142792177", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "974a024c-61f1-4c3c-ba4e-fa1153d8a5d8"}], "security_groups": [{"name": "tempest-securitygroup--464461750"}], "key_name": "tempest-keypair-178459495", "user_data": "}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:06.279076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:06.286623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e33abe18-33bc-4c41-a5dd-82e228fb4568 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.176380 Aug 09 12:31:06.287185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 423/852] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:06 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:06.304973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] validate_networks() for [('974a024c-61f1-4c3c-ba4e-fa1153d8a5d8', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:31:06.943190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:31:06.943604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:31:06.944286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:31:06.945015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:31:06.945420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:31:06.954618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:06.955324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:06.955755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:06.956598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:06.957055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:06.957475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:06.974226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for project cffa9ae943de44bc8264914e39c80cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:31:06.978210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Getting quotas for user c8982b93df5744bbbdeb7a956df06502 and project cffa9ae943de44bc8264914e39c80cfa. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:31:06.989601 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:31:06.991853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:31:07.045538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b83469ec-5eea-4e9d-be57-7e0d6ef6fa83 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.862661 Aug 09 12:31:07.046389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 430/853] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:31:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 12:31:07.057586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ccd4cdca-1761-4ac8-af20-dee5a56c4235 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:07.058109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ccd4cdca-1761-4ac8-af20-dee5a56c4235 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:07.114804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ccd4cdca-1761-4ac8-af20-dee5a56c4235 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:07.122259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ccd4cdca-1761-4ac8-af20-dee5a56c4235 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1241 microversion: 2.1 time: 0.068691 Aug 09 12:31:07.122835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 424/854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:07 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:07.307960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:07.308538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:07.314891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:07.315433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:07.315865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:07.316598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:07.317026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:07.317475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:07.448129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:07.455806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9005464f-336f-48dc-8b59-4fed8b65e8ef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.152559 Aug 09 12:31:07.456729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 431/855] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:07 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:08.143661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:08.144258 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:08.151507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:08.152008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:08.152454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:08.158525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:08.159584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:08.160144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:08.224675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:08.235238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0bf52554-0e7d-4f4a-923c-82473bf72569 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1301 microversion: 2.1 time: 0.095072 Aug 09 12:31:08.235816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 425/856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:08 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:08.478241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:08.478822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:08.485435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:08.485942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:08.486369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:08.487054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:08.487628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:08.488140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:08.636451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:08.644421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-756bbacd-c5d3-4ffa-ac93-eb56e58fa604 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.170245 Aug 09 12:31:08.645208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 432/857] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:08 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:09.257223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:09.258526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:09.264893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:09.265384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:09.265843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:09.266543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:09.266995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:09.267414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:09.401118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:09.408672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b28c0459-4333-4b69-9672-90e04cb00bf8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.156032 Aug 09 12:31:09.409453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 426/858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:09 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:09.665976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:09.666804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:09.673298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:09.673819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:09.674286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:09.675018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:09.675443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:09.676104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:09.779038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-d595f15e-ce13-4457-a9ba-b612ba07573d req-84b5cd95-8054-4871-be37-1d7e4ad8f310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291aa64f-9bc8-4e3d-8d9b-791feda19838", "tag": "48b13038-6ce6-4b9f-a44a-dfce61e4f322"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:09.789724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-d595f15e-ce13-4457-a9ba-b612ba07573d req-84b5cd95-8054-4871-be37-1d7e4ad8f310 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:09.790350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-d595f15e-ce13-4457-a9ba-b612ba07573d req-84b5cd95-8054-4871-be37-1d7e4ad8f310 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:09.791043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-d595f15e-ce13-4457-a9ba-b612ba07573d req-84b5cd95-8054-4871-be37-1d7e4ad8f310 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:09.803132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-d595f15e-ce13-4457-a9ba-b612ba07573d req-84b5cd95-8054-4871-be37-1d7e4ad8f310 service nova] Creating event network-changed:48b13038-6ce6-4b9f-a44a-dfce61e4f322 for instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 on hv-cinder-85236 Aug 09 12:31:09.808801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-d595f15e-ce13-4457-a9ba-b612ba07573d req-84b5cd95-8054-4871-be37-1d7e4ad8f310 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033616 Aug 09 12:31:09.809702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 427/859] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:31:09.834333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:09.841997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2091387-bf47-409a-acb7-748246762016 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.181055 Aug 09 12:31:09.842564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 433/860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:10.431702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:10.432405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:10.439048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:10.439533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:10.439964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:10.440913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:10.441215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:10.441636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:10.576998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:10.585108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ea590610-1e03-4e49-a843-cc9be31bd9bc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.158122 Aug 09 12:31:10.585721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 428/861] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:10 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:10.865736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:10.866357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:10.873667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:10.874155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:10.874583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:10.875301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:10.875743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:10.876157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:11.010003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:11.018097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7989a4e8-64e1-420e-8449-34cf4d5e65db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.158084 Aug 09 12:31:11.018697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 434/862] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:10 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:11.606382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:11.606954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:11.608964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:11.615134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:11.615595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:11.616025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:11.616750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:11.617196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:11.617607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:11.763288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:11.775018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-870ed4fa-7431-4dd1-ada7-a5bca1b6f47a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.172288 Aug 09 12:31:11.775932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 429/863] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:11 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:12.039556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:12.040155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:12.047433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:12.047907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:12.048301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:12.049261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:12.049682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:12.050099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:12.186128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:12.194398 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-37fad585-f1ee-4fa1-823d-c01a651a77ec tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.159008 Aug 09 12:31:12.194973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 435/864] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:12 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:12.797215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:12.797891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:12.805387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:12.805866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:12.806320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:12.806979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:12.807424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:12.807838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:12.949415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:12.960325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b6bfc79c-d932-485a-b4f5-2c21cc79c71e tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.167573 Aug 09 12:31:12.960941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 430/865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:12 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:13.219427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:13.220307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:13.228597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:13.229119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:13.229550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:13.230268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:13.231389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:13.231792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:13.369571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:13.381642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b359aa72-5d6a-4268-813e-628ff313a30a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.168896 Aug 09 12:31:13.382208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 436/866] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:13 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:13.985819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:13.986740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:13.998956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:13.999763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:14.000532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:14.001668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:14.002460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:14.003164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:14.140807 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:14.149074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f237316c-7096-4487-bdcf-eec30d94b7a5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.169236 Aug 09 12:31:14.149553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 431/867] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:13 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:14.403815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:14.404344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:14.411263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:14.411741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:14.412187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:14.412916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:14.413473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:14.413952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:14.432397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:14.591455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:14.610363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-90f58c62-8e6a-48e2-b083-78bf678d9083 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.210486 Aug 09 12:31:14.623884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 437/868] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:14 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:15.170822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:15.172065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:15.179385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:15.180019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:15.180482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:15.181184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:15.181637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:15.182076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:15.319217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:15.327141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-30a72206-d03d-4fc9-b08e-3db9f4b06478 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.160374 Aug 09 12:31:15.327782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 432/869] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:15 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:15.634421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:15.638962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:15.641983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:15.642455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:15.642910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:15.643613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:15.644068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:15.644531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:15.780034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:15.787826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1a17b93d-130f-46c0-a683-ad5c7ea0f760 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.159012 Aug 09 12:31:15.788423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 438/870] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:15 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:16.352263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:16.352942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:16.360544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:16.361082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:16.361564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:16.362331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:16.362829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:16.363331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:16.503471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:16.511143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-943ae793-bb70-4314-83a3-b90569335172 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.165137 Aug 09 12:31:16.511714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 433/871] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:16 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:16.812679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:16.813666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:16.824749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:16.825566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:16.826265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:16.827409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:16.828152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:16.828976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:16.964863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:16.971018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:16.979071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34484727-a3ca-460d-8dd5-bcc72f33bb1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.173003 Aug 09 12:31:16.979570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 439/872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:16 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:17.539986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:17.541078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:17.543931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=14 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:17.554335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:17.554881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:17.555308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:17.555997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:17.556465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:17.556882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:17.694287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:17.702658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b5b81f31-5d2a-46fd-afc0-7c270fbe9d9a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.169813 Aug 09 12:31:17.703231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 434/873] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:17 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:17.734302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-d7f1a3a5-51c8-4202-af11-0e9d7e9ae6fd req-e587d7d5-d815-4bb0-babe-578ec74c2667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291aa64f-9bc8-4e3d-8d9b-791feda19838", "name": "network-vif-plugged", "status": "completed", "tag": "48b13038-6ce6-4b9f-a44a-dfce61e4f322"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:17.739456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:17.746299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d7f1a3a5-51c8-4202-af11-0e9d7e9ae6fd req-e587d7d5-d815-4bb0-babe-578ec74c2667 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:17.746761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d7f1a3a5-51c8-4202-af11-0e9d7e9ae6fd req-e587d7d5-d815-4bb0-babe-578ec74c2667 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:17.747178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-d7f1a3a5-51c8-4202-af11-0e9d7e9ae6fd req-e587d7d5-d815-4bb0-babe-578ec74c2667 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:17.759171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-d7f1a3a5-51c8-4202-af11-0e9d7e9ae6fd req-e587d7d5-d815-4bb0-babe-578ec74c2667 service nova] Creating event network-vif-plugged:48b13038-6ce6-4b9f-a44a-dfce61e4f322 for instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 on hv-cinder-85236 Aug 09 12:31:17.764332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-d7f1a3a5-51c8-4202-af11-0e9d7e9ae6fd req-e587d7d5-d815-4bb0-babe-578ec74c2667 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034308 Aug 09 12:31:17.765023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 440/874] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:31:17.999610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:18.000336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:18.006339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:18.006894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:18.008040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:18.008843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:18.009312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:18.009724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:18.014974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:18.155019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:18.162815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6f46114f-4673-4b84-adc9-40a9dab3d1f5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.167547 Aug 09 12:31:18.163411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 435/875] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:17 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:18.729225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:18.730719 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:18.741593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:18.742077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:18.742513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:18.743208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:18.743663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:18.744086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:18.874540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:18.884428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-027456fa-73dd-44c4-af4e-a3ca1f4e9019 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1366 microversion: 2.1 time: 0.163034 Aug 09 12:31:18.885021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 441/876] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:18 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:19.185481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:19.186056 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:19.194660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:19.195144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:19.195574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:19.196263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:19.196746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:19.197170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:19.346087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:19.354311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a7b44c74-1d0c-4875-8c60-6e9e7a035b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.173990 Aug 09 12:31:19.354880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 436/877] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:19 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:19.798043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-df334612-c839-4856-92c3-624a3e85c791 req-7bf840dc-e80d-4fbf-a754-057d618250d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a368964e-2b12-4ec7-a757-4cf2796910ab", "name": "network-vif-plugged", "status": "completed", "tag": "547a0884-98cf-4ddd-b43b-9c8ffe94c31a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:19.808683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-df334612-c839-4856-92c3-624a3e85c791 req-7bf840dc-e80d-4fbf-a754-057d618250d8 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:19.809180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-df334612-c839-4856-92c3-624a3e85c791 req-7bf840dc-e80d-4fbf-a754-057d618250d8 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:19.809602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-df334612-c839-4856-92c3-624a3e85c791 req-7bf840dc-e80d-4fbf-a754-057d618250d8 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:19.823850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-df334612-c839-4856-92c3-624a3e85c791 req-7bf840dc-e80d-4fbf-a754-057d618250d8 service nova] Creating event network-vif-plugged:547a0884-98cf-4ddd-b43b-9c8ffe94c31a for instance a368964e-2b12-4ec7-a757-4cf2796910ab on hv-cinder-85236 Aug 09 12:31:19.828951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-df334612-c839-4856-92c3-624a3e85c791 req-7bf840dc-e80d-4fbf-a754-057d618250d8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034679 Aug 09 12:31:19.829547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 442/878] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:31:19.910348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:19.911307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:19.918682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:19.919162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:19.919595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:19.920282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:19.920756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:19.921177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:20.062755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:20.070491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71270c6d-d09b-4322-ab0c-f91431ebf583 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1556 microversion: 2.1 time: 0.166556 Aug 09 12:31:20.071067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 437/879] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:19 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:20.091447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:20.092023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:20.098793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:20.099281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:20.099717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:20.100458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:20.101273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:20.101693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:20.200042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e9bccff5-a643-46e8-804a-15defc165ef5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112756 Aug 09 12:31:20.200906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 443/880] 10.222.0.60 () {58 vars in 1275 bytes} [Tue Aug 9 12:31:20 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:31:20.376988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:20.377551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:20.383817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:20.384368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:20.384891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:20.385785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:20.386853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:20.387328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:20.694888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:20.702716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ae6400ba-ad23-404c-8008-2ed0ecd5f8c8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.330921 Aug 09 12:31:20.703392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 438/881] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:20 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:31:21.309436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-adfed72b-0dbd-47e0-a380-8bdc756e62b0 req-eb511b45-851c-44b1-8a24-0d68f0663128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291aa64f-9bc8-4e3d-8d9b-791feda19838", "tag": "48b13038-6ce6-4b9f-a44a-dfce61e4f322"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:21.318962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-adfed72b-0dbd-47e0-a380-8bdc756e62b0 req-eb511b45-851c-44b1-8a24-0d68f0663128 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:21.319483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-adfed72b-0dbd-47e0-a380-8bdc756e62b0 req-eb511b45-851c-44b1-8a24-0d68f0663128 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:21.319905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-adfed72b-0dbd-47e0-a380-8bdc756e62b0 req-eb511b45-851c-44b1-8a24-0d68f0663128 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:21.331425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-adfed72b-0dbd-47e0-a380-8bdc756e62b0 req-eb511b45-851c-44b1-8a24-0d68f0663128 service nova] Creating event network-changed:48b13038-6ce6-4b9f-a44a-dfce61e4f322 for instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 on hv-cinder-85236 Aug 09 12:31:21.336904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-adfed72b-0dbd-47e0-a380-8bdc756e62b0 req-eb511b45-851c-44b1-8a24-0d68f0663128 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031690 Aug 09 12:31:21.337523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 444/882] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:31:21.723393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:21.724140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:21.736277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:21.737179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:21.737614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:21.738331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:21.738786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:21.739214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:21.950328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:21.958396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-32a94595-990b-4173-ae38-fac3b9a31b85 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1259 microversion: 2.1 time: 0.238930 Aug 09 12:31:21.959199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 439/883] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:21 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:22.981148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:22.981820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:22.988098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:22.988626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:22.989055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:22.989738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:22.990171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:22.990600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:23.129864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:23.138887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9eaa8d41-b295-4c8e-9a1c-7abf6324945d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1443 microversion: 2.1 time: 0.162663 Aug 09 12:31:23.139433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 445/884] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:22 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1443 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:31:23.159141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:23.159696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:23.166516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:23.167005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:23.167433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:23.168110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:23.168622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:23.169033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:23.308937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:23.320555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-21655e2b-2cea-44ae-b4ab-61c489cd0262 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1443 microversion: 2.1 time: 0.165013 Aug 09 12:31:23.321490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 440/885] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:31:23 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:31:25.311392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-9ee20b0d-8985-4773-bad1-65835126d591 req-16ada773-210f-4234-b2e5-bc90145832b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a368964e-2b12-4ec7-a757-4cf2796910ab", "tag": "547a0884-98cf-4ddd-b43b-9c8ffe94c31a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:25.321346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9ee20b0d-8985-4773-bad1-65835126d591 req-16ada773-210f-4234-b2e5-bc90145832b3 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:25.321817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9ee20b0d-8985-4773-bad1-65835126d591 req-16ada773-210f-4234-b2e5-bc90145832b3 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:25.322235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9ee20b0d-8985-4773-bad1-65835126d591 req-16ada773-210f-4234-b2e5-bc90145832b3 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:25.333221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-9ee20b0d-8985-4773-bad1-65835126d591 req-16ada773-210f-4234-b2e5-bc90145832b3 service nova] Creating event network-changed:547a0884-98cf-4ddd-b43b-9c8ffe94c31a for instance a368964e-2b12-4ec7-a757-4cf2796910ab on hv-cinder-85236 Aug 09 12:31:25.338256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-9ee20b0d-8985-4773-bad1-65835126d591 req-16ada773-210f-4234-b2e5-bc90145832b3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030564 Aug 09 12:31:25.338849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 446/886] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:31:26.876664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:26.877274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:26.885679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:26.886171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:26.886608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:26.887310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:26.887760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:26.888179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:26.912567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-94f6d4da-e401-47ef-b364-209191f9f527 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/ips" status: 200 len: 150 microversion: 2.20 time: 0.042545 Aug 09 12:31:26.913113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 441/887] 10.222.0.60 () {60 vars in 1289 bytes} [Tue Aug 9 12:31:26 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:31:29.043985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:29.044608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:29.046531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:29.052457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:29.052935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:29.053361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:29.054042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:29.054778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:29.055224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:29.079555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lazy-loading 'flavor' on Instance uuid 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:31:29.293957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71a3b0a4-0e8c-4715-b3c8-5d288c430a8e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/action" status: 202 len: 0 microversion: 2.20 time: 0.255892 Aug 09 12:31:29.294671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 447/888] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Aug 9 12:31:29 2022] POST /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:31:29.303196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:29.303810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:29.306461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:29.311944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:29.312608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:29.313075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:29.313960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:29.314388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:29.314818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:29.453686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:29.462182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:29.463670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:29.464995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5208bf9a-5815-4cae-9cf6-508fcf156647 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.165787 Aug 09 12:31:29.465552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 442/889] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:29 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:30.494388 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:30.495937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:30.506619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:30.507485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:30.507918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:30.508642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:30.509080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:30.509521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:30.657112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:30.665459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:30.666980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:30.668127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2cde2256-d40f-4307-bcdd-5b3a6a293504 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.181772 Aug 09 12:31:30.668714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 448/890] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:30 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:31.692218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:31.692834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:31.699755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:31.700251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:31.700720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:31.701397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:31.701871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:31.702296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:31.842836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:31.853989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:31.855474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:31.856706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-47dfeb68-7ca1-4d23-a209-2d8a839552ef tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.168640 Aug 09 12:31:31.857266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 443/891] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:31 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:32.884993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:32.885974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:32.893425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:32.893887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:32.894318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:32.895013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:32.895458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:32.895877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:33.031754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:33.044058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:33.046439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:33.048095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33e373f9-edfb-41b3-8635-aea535bff767 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.169754 Aug 09 12:31:33.049079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 449/892] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:32 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:34.075469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:34.076082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:34.082989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:34.083471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:34.083898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:34.084643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:34.085094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:34.085510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:34.224054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:34.232311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:34.233911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:34.235067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-641de755-865d-488a-b620-510a8ea7fac0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.164273 Aug 09 12:31:34.235604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 444/893] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:34 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:35.262903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:35.263853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:35.274755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:35.275238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:35.275652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:35.276365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:35.276850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:35.277274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:35.417056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:35.425399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:35.426885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:35.428041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e80949f8-c51e-4e6e-a40b-c8edccaed4d0 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.171904 Aug 09 12:31:35.428645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 450/894] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:35 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:36.454542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:36.455457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:36.465519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:36.466290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:36.466934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:36.467969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:36.468710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:36.469350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:36.618929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:36.627599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:36.629145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:36.630320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9ea19bc0-0eef-41e5-8bec-c54023864c19 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.182392 Aug 09 12:31:36.630921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 445/895] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:36 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:37.659689 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:37.660725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:37.670408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:37.671217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:37.671971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:37.673048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:37.673837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:37.674530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:37.827355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:37.839161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:37.841515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:37.843196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34c54028-9736-48a8-acb1-c28be62620d9 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.190256 Aug 09 12:31:37.844032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 451/896] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:37 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:38.871821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:38.872550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:38.881085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:38.881770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:38.882235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:38.883197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:38.883876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:38.884571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:39.017143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:39.025882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:39.027377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:39.028574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-506e61ed-e404-4704-a625-3418cb8429ee tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.161133 Aug 09 12:31:39.029137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 446/897] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:38 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:40.055246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:40.056198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:40.063698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:40.064198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:40.064660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:40.065344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:40.065836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:40.066250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:40.193984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:40.202534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:40.204018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:40.205202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-723c97fd-36b6-4def-b80c-02e686ad5c5d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.156560 Aug 09 12:31:40.205768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 452/898] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:40 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:41.231344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:41.232005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:41.238952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:41.239426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:41.239854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:41.240575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:41.241020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:41.241441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:41.376102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:41.387981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:41.389510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:41.390676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7689cf44-34c3-44df-8e6b-827155103239 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1742 microversion: 2.20 time: 0.163748 Aug 09 12:31:41.391238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 447/899] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:41 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:42.425859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:42.426786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:42.437279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:42.437757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:42.438189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:42.438881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:42.439326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:42.439730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:42.584839 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:42.597431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:42.599784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:42.601562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac94358a-1c66-4a96-9181-d06757eaed6e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1742 microversion: 2.20 time: 0.182022 Aug 09 12:31:42.602286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 453/900] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:42 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:43.628146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:43.629012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:43.638007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:43.638647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:43.639311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:43.640075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:43.640563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:43.640987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:43.773852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:43.782178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:43.783755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:43.784871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2a11959b-a58f-4169-a0d4-4156416fcb57 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1742 microversion: 2.20 time: 0.162082 Aug 09 12:31:43.785434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 448/901] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:43 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:44.812025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:44.813068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:44.823726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:44.824567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:44.825277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:44.826401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:44.827165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:44.827659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:44.830448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:44.965127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:44.974334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:44.975829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:44.977016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91dd3896-0623-4b52-90b6-992d35263227 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1742 microversion: 2.20 time: 0.171750 Aug 09 12:31:44.977588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 454/902] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:44 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:45.001891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-1fe16d9b-149a-4435-96a4-8cfb0df7ea81 req-5cced864-37b2-4c87-89f4-0ae3133f1a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74", "name": "network-vif-plugged", "status": "completed", "tag": "5ba0f75a-7788-4550-a660-9c0021b0abc0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:31:45.012122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-1fe16d9b-149a-4435-96a4-8cfb0df7ea81 req-5cced864-37b2-4c87-89f4-0ae3133f1a0e service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:45.012783 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-1fe16d9b-149a-4435-96a4-8cfb0df7ea81 req-5cced864-37b2-4c87-89f4-0ae3133f1a0e service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:45.013056 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-1fe16d9b-149a-4435-96a4-8cfb0df7ea81 req-5cced864-37b2-4c87-89f4-0ae3133f1a0e service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:45.027047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-1fe16d9b-149a-4435-96a4-8cfb0df7ea81 req-5cced864-37b2-4c87-89f4-0ae3133f1a0e service nova] Creating event network-vif-plugged:5ba0f75a-7788-4550-a660-9c0021b0abc0 for instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 on hv-cinder-85236 Aug 09 12:31:45.032112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-1fe16d9b-149a-4435-96a4-8cfb0df7ea81 req-5cced864-37b2-4c87-89f4-0ae3133f1a0e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034005 Aug 09 12:31:45.032815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 449/903] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:31:46.004030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:46.004827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:46.013639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:46.014386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:46.014922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:46.015854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:46.016515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:46.017200 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:46.162018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:46.175185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:46.177391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:46.179136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-773d6343-7891-4d24-98d8-f84e066d9399 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1742 microversion: 2.20 time: 0.180897 Aug 09 12:31:46.179660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 455/904] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:45 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1742 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:47.209624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:47.210793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:47.221194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:47.221981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:47.222688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:47.223814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:47.224614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:47.225296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:47.366565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:47.379781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:47.382246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:47.383805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2051266c-d17e-4576-a3da-0a788d24d5c7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1742 microversion: 2.20 time: 0.182173 Aug 09 12:31:47.384355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 450/905] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:47 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:48.407733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:48.408309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:48.415353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:48.415845 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:48.416285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:48.417013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:48.417473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:48.417903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:48.553568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:48.561932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:48.563446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:48.564639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0d2be88-b67d-4327-a183-f35f7c2451ad tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.161160 Aug 09 12:31:48.566851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 456/906] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:48 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:49.587370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:49.588858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:49.596197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:49.596714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:49.597163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:49.597862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:49.598532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:49.598964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:49.602088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=90 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:49.759106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:49.769776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:49.771549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:49.774026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-79ea2a39-e117-4997-be15-3d39d3c30b50 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.190711 Aug 09 12:31:49.775108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 451/907] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:49 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:50.798484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:50.799217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:50.805903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:50.806694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:50.807312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:50.808080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:50.810052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:50.810052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:50.956447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:50.964799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:50.966283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:50.967449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59facc38-64ef-4ebd-a46e-4a80bd23e38c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.173594 Aug 09 12:31:50.968000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 457/908] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:50 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:51.996169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:51.996853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:52.003930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:52.004649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:52.005123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:52.005845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:52.006288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:52.006714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:52.163753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:52.173058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:52.174666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:52.176135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-34bd537e-41fe-4a4e-b923-f02084704215 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.184201 Aug 09 12:31:52.176760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 452/909] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:51 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:53.200553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:53.201788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:53.209008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:53.209499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:53.210197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:53.211190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:53.211702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:53.212332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:53.374090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:53.383638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:53.385364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:53.386608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-da255882-ae11-4892-a717-bda13a49bce1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.190155 Aug 09 12:31:53.387220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 458/910] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:53 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:54.411209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:54.411921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:54.418756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:54.419141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:54.419641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:54.420428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:54.421021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:54.421429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:54.567112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:54.575996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:54.576972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:54.578073 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-16f9109f-56dd-4f52-bd37-16468bd0ec10 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.171072 Aug 09 12:31:54.592215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 453/911] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:54 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:55.605700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:55.605700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:55.612014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:55.612535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:55.613194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:55.614224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:55.614685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:55.615120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:55.833153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:55.843285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:55.845896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:55.847203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d152876e-3f4d-42b5-81f5-8d690f7fc623 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.246798 Aug 09 12:31:55.847967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 459/912] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:55 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:56.871759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:56.873154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:56.880266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:56.881498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:56.882230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:56.882971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:56.883419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:56.883851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:57.083667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:57.093403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:57.095019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:57.096471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-00cced67-5c6b-4c53-930f-ea864f75fc8c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.229271 Aug 09 12:31:57.112428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 454/913] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:56 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:31:58.119544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:58.120523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:58.127206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:58.127938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:58.128224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:58.128951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:58.129407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:58.129829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:58.284542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:58.293476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:58.294990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:58.296178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15d979b2-491b-4cbe-81cf-67014883cca8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.180770 Aug 09 12:31:58.296851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 460/914] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:58 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:31:59.320754 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:31:59.321377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:31:59.327570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:59.328045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:59.328509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:59.329199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:31:59.329642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:31:59.330056 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:31:59.468706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:59.478409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:59.479874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:31:59.481070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9025c20a-b3a0-4b0f-9784-fed26eab4a8f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1737 microversion: 2.20 time: 0.164734 Aug 09 12:31:59.481639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 455/915] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:31:59 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:00.505187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:00.505798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:00.508301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=28 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:00.513411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:00.513905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:00.514341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:00.515044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:00.515497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:00.515920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:00.705933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:00.714668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:00.716161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:00.717354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f3817649-7437-449f-a467-a333dcc7b953 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1719 microversion: 2.20 time: 0.216289 Aug 09 12:32:00.717921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 461/916] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:00 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:01.741439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:01.742035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:01.744837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=28 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:01.750637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:01.751123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:01.751554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:01.752262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:01.752747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:01.753169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:01.888341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:01.896572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:01.898049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:01.899212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d691006-b7fe-48aa-a00e-edbff86a6b58 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1719 microversion: 2.20 time: 0.161845 Aug 09 12:32:01.899772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 456/917] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:01 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:02.922747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:02.923342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:02.930231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:02.931335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:02.931335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:02.931889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:02.932338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:02.932778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:03.077626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:03.086482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:03.089482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:03.090662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91c30ad1-6817-494f-a277-62d1d9c9a643 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1719 microversion: 2.20 time: 0.172132 Aug 09 12:32:03.091230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 462/918] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:02 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:03.156698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-7bab82b0-77d5-4b36-99ac-51d32742fbc9 req-6e3e3cea-3dcb-4e85-9ae0-ed4e98932914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74", "name": "network-vif-unplugged", "status": "completed", "tag": "5ba0f75a-7788-4550-a660-9c0021b0abc0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:03.169323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7bab82b0-77d5-4b36-99ac-51d32742fbc9 req-6e3e3cea-3dcb-4e85-9ae0-ed4e98932914 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:03.170001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7bab82b0-77d5-4b36-99ac-51d32742fbc9 req-6e3e3cea-3dcb-4e85-9ae0-ed4e98932914 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:03.170437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-7bab82b0-77d5-4b36-99ac-51d32742fbc9 req-6e3e3cea-3dcb-4e85-9ae0-ed4e98932914 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:03.182300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-7bab82b0-77d5-4b36-99ac-51d32742fbc9 req-6e3e3cea-3dcb-4e85-9ae0-ed4e98932914 service nova] Creating event network-vif-unplugged:5ba0f75a-7788-4550-a660-9c0021b0abc0 for instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 on hv-cinder-85236 Aug 09 12:32:03.187396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-7bab82b0-77d5-4b36-99ac-51d32742fbc9 req-6e3e3cea-3dcb-4e85-9ae0-ed4e98932914 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034590 Aug 09 12:32:03.187982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 457/919] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:04.116555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:04.117166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:04.125366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:04.125856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:04.126284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:04.126973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:04.127419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:04.127840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:04.266510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:04.277185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:04.278654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:04.279803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bee0ba58-f893-498d-9c23-0d837ffb2289 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1662 microversion: 2.20 time: 0.168441 Aug 09 12:32:04.280360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 463/920] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:04 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:04.305904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca7e8391-f310-4741-8fe9-14ec391564ea"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:04.308316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:04.315051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:04.315521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:04.315946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:04.316656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:04.317100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:04.317506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:04.616743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0a2dba21-f09e-4141-b904-f06a2619b119 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317837 Aug 09 12:32:04.617377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 458/921] 10.222.0.60 () {62 vars in 1364 bytes} [Tue Aug 9 12:32:04 2022] POST /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 12:32:04.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:04.762221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:04.768789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:04.769288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:04.769718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:04.770395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:04.770838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:04.771250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:05.063734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2e2c9c15-25ca-41b4-a6f9-86f72f870341 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/os-volume_attachments/ca7e8391-f310-4741-8fe9-14ec391564ea" status: 202 len: 0 microversion: 2.20 time: 0.308342 Aug 09 12:32:05.064511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 464/922] 10.222.0.60 () {60 vars in 1457 bytes} [Tue Aug 9 12:32:04 2022] DELETE /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/os-volume_attachments/ca7e8391-f310-4741-8fe9-14ec391564ea => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:32:05.125850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:05.126472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:05.132629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:05.133132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:05.133583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:05.134337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:05.134777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:05.135189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:05.165506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117661) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 12:32:05.177635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:05.178148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:05.185909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:05.186399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:05.186826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:05.187512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:05.187964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:05.188391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:05.212069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d25094a5-38d2-4211-8361-c120b78d0d68 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/ips" status: 200 len: 145 microversion: 2.1 time: 0.038279 Aug 09 12:32:05.212667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 465/923] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:32:05 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:05.239083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5c016496-f799-489f-828a-d17120d5ec9b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "POST /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/action" status: 202 len: 0 microversion: 2.20 time: 0.117148 Aug 09 12:32:05.239846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 459/924] 10.222.0.60 () {62 vars in 1319 bytes} [Tue Aug 9 12:32:05 2022] POST /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:32:05.248796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:05.249401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:05.255414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:05.255895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:05.256322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:05.257031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:05.257478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:05.257896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:05.406011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:05.414468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:05.416418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:05.417852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8252cabe-b125-4e85-8c64-68b14be77bc3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1670 microversion: 2.20 time: 0.173173 Aug 09 12:32:05.418401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 466/925] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:05 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 12:32:06.442368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:06.442985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:06.449238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:06.449706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:06.450159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:06.451018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:06.451472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:06.452085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:06.585493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05859f2c-f354-4509-b899-302602964347"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:06.589693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:06.597082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:06.597895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:06.598084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:06.598811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:06.598974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:06.599505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:06.599928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:06.607134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:06.608666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:06.609842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6911479f-ab75-49b1-8f61-6249ecd5689a tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.172096 Aug 09 12:32:06.610405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 460/926] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:06 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:07.002099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:07.029908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4436c21b-182b-4884-be49-61eea45820d1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448328 Aug 09 12:32:07.030540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 467/927] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:32:06 2022] POST /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:07.634541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:07.635234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:07.642168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:07.642663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:07.643099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:07.643842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:07.644296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:07.644748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:07.866478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:07.875505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:07.877047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:07.878232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0fe44e6f-2f36-442f-b8b9-3e9057817e0e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.247975 Aug 09 12:32:07.878828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 461/928] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:07 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:08.905045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:08.905733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:08.912406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:08.912870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:08.913516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:08.914201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:08.914830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:08.915250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:09.051870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:09.061408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:09.063244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:09.064483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-212f4219-68af-4408-89c0-098e3c937766 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.165429 Aug 09 12:32:09.065018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 468/929] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:08 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:10.089384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:10.090907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:10.097751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:10.098329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:10.098755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:10.099488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:10.100155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:10.100595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:10.240923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:10.250356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:10.251929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:10.253157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88b0eb5c-c441-4bf7-8ac5-90f2b609b271 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.168211 Aug 09 12:32:10.255666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 462/930] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:10 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:11.280317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:11.281531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:11.305036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:11.305036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:11.305450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:11.306143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:11.306865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:11.307333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:11.448054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:11.456325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:11.457844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:11.458999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7854d0f9-abab-400e-a7a0-0c19b50f1e73 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.184665 Aug 09 12:32:11.459550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 469/931] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:11 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:12.482671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:12.483400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:12.490033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:12.490616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:12.491092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:12.491792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:12.492248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:12.492699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:12.630092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:12.638222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:12.639966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:12.641393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1536814e-4222-49b2-bc48-2e74408a9ee2 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.163292 Aug 09 12:32:12.642101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 463/932] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:12 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:13.668275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:13.668951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:13.676827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:13.677354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:13.677859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:13.678564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:13.679015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:13.679436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:13.819236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:13.827690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:13.829215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:13.830386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0a7c7528-ae0a-48ba-802e-5e98fbc0e9a3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.168360 Aug 09 12:32:13.831129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 470/933] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:13 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:14.854207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:14.855148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:14.862044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:14.862529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:14.862958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:14.863654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:14.864104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:14.864587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:15.015232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:15.017578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:15.025329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:15.026747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:15.027906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9fdd0b95-9443-4a06-ad19-7efe780c74cd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.177977 Aug 09 12:32:15.028482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 464/934] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:14 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:16.051123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:16.052283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:16.059814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:16.060291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:16.060827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:16.061548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:16.062076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:16.062639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:16.208106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:16.216671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:16.218171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:16.219400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-28720899-cee5-43d2-ba6f-fc184356395e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.172241 Aug 09 12:32:16.227727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 471/935] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:16 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:17.245412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:17.246215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:17.255307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:17.255857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:17.256350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:17.257079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:17.257524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:17.257925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:17.401269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:17.410146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:17.411654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:17.412881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aac8126c-a182-46f2-b96f-de623e8f800b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.173666 Aug 09 12:32:17.413779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 465/936] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:17 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:18.435876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:18.436583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:18.443028 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:18.443518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:18.443962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:18.444656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:18.445318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:18.445737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:18.593165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:18.601409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:18.602909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:18.604146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d73f92df-029a-45ed-831f-6f2c1cab8540 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.172633 Aug 09 12:32:18.604745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 472/937] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:18 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:19.630600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:19.631245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:19.639315 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:19.640328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:19.640906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:19.641714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:19.642339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:19.643220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:19.795013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:19.803239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:19.804787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:19.805955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c0a51d31-08bc-4699-91b4-fb47bfb8bd23 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.182042 Aug 09 12:32:19.806504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 466/938] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:19 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:20.832917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:20.833916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:20.844953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:20.845756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:20.846499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:20.847630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:20.848438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:20.849136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:20.985192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:20.998169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:21.000571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:21.002324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e9bc5cc8-b2b4-46a6-a352-bc5c6db5757e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.175709 Aug 09 12:32:21.003036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 473/939] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:20 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:22.028552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:22.029179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:22.036104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:22.036630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:22.037068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:22.037796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:22.038244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:22.038661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:22.187614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:22.199975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:22.202387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:22.204058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cdb537cf-099b-4d13-b4fe-e432fd5f03e3 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.179569 Aug 09 12:32:22.204858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 467/940] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:22 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:23.231571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:23.232252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:23.240057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:23.240686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:23.241227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:23.242206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:23.242745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:23.243246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:23.397965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:23.406618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:23.408154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:23.409342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-209ccfd3-9de3-42ce-bc8b-bb211f49a37c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.184708 Aug 09 12:32:23.409951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 474/941] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:23 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:24.435318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:24.435924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:24.442950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:24.443430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:24.443860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:24.444599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:24.445050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:24.445467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:24.592063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:24.605156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:24.606667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:24.607835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a3af495a-7369-413d-bfda-12fc81820f44 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.176699 Aug 09 12:32:24.608408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 468/942] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:24 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:25.631354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:25.631928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:25.639079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:25.639522 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:25.639926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:25.640780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:25.641269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:25.641692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:25.789565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:25.798892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:25.800399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:25.801552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-392c577f-0be5-478a-a26d-ff4e0ee418d8 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.174250 Aug 09 12:32:25.802102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 475/943] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:25 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:26.326873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:26.329228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:26.336024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:26.336548 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:26.336986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:26.337742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:26.338194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:26.338619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:26.368061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3657318d-6c2b-49c1-831c-0deb7340d14b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Aug 09 12:32:26.368671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 469/944] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:32:26 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:32:26.379615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:26.380163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:26.385916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:26.386397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:26.386829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:26.387563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:26.388014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:26.388450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:26.419007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71c8d5df-597f-4340-bceb-7856e1191e58 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/05859f2c-f354-4509-b899-302602964347" status: 200 len: 194 microversion: 2.1 time: 0.043266 Aug 09 12:32:26.419607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 476/945] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Aug 9 12:32:26 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/05859f2c-f354-4509-b899-302602964347 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:26.825797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:26.826403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:26.832704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:26.833198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:26.833629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:26.834297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:26.834753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:26.835172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:26.969117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:26.977146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:26.978623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:26.979775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ec61ef3e-eb0e-4823-96e6-7bbf23b0a688 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.158078 Aug 09 12:32:26.980313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 470/946] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:26 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:27.792140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fc1dccf-77ab-41ef-8428-f4ccb3f2b326"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:27.795161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:27.802093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:27.802569 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:27.802996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:27.803678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:27.804121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:27.804557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:28.003750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:28.004371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:28.011580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:28.012079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:28.012553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:28.013216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:28.013666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:28.014082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:28.113190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89f9a288-b939-4c9a-8f25-317da2ec7282 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "POST /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325557 Aug 09 12:32:28.114184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 477/947] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:32:27 2022] POST /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:32:28.157557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:28.169162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:28.170813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:28.172132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-943af007-792f-4d30-845d-3b5502e17950 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.172502 Aug 09 12:32:28.172777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 471/948] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:27 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:29.166556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-ce5fc3f3-5759-4585-8d7e-b74542df72a5 req-9b261f63-c14d-4765-918c-3d2a5e47f0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74", "name": "network-vif-plugged", "status": "completed", "tag": "5ba0f75a-7788-4550-a660-9c0021b0abc0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:29.178888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ce5fc3f3-5759-4585-8d7e-b74542df72a5 req-9b261f63-c14d-4765-918c-3d2a5e47f0d5 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:29.179377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ce5fc3f3-5759-4585-8d7e-b74542df72a5 req-9b261f63-c14d-4765-918c-3d2a5e47f0d5 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:29.179895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-ce5fc3f3-5759-4585-8d7e-b74542df72a5 req-9b261f63-c14d-4765-918c-3d2a5e47f0d5 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:29.192681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-ce5fc3f3-5759-4585-8d7e-b74542df72a5 req-9b261f63-c14d-4765-918c-3d2a5e47f0d5 service nova] Creating event network-vif-plugged:5ba0f75a-7788-4550-a660-9c0021b0abc0 for instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 on hv-cinder-85236 Aug 09 12:32:29.196973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:29.198063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-ce5fc3f3-5759-4585-8d7e-b74542df72a5 req-9b261f63-c14d-4765-918c-3d2a5e47f0d5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036119 Aug 09 12:32:29.198877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:29.199420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 478/949] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:29.210622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:29.211181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:29.211862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:29.212675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:29.213196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:29.213622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:29.359146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:29.367185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:29.368741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:29.370232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7d3d580f-b1bc-4571-a5ff-0423b821dc5c tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.178515 Aug 09 12:32:29.371216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 472/950] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:29 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:30.401183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:30.402309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:30.410050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:30.410531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:30.410960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:30.411651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:30.412098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:30.412558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:30.553569 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:30.567041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:30.569277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:30.571088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4e3e7781-40dd-4b44-9232-430d927c5b48 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.177407 Aug 09 12:32:30.571905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 479/951] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:30 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:31.599692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:31.600767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:31.610759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:31.611244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:31.611684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:31.612401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:31.612867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:31.613321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:31.761215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:31.769552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:31.771149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:31.772476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5402bc09-81d6-44cf-816d-be9f0153fce7 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1728 microversion: 2.20 time: 0.179387 Aug 09 12:32:31.773022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 473/952] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:31 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:32.798858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:32.799484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:32.801916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=38 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:32.807684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:32.808197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:32.808711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:32.809401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:32.809851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:32.810266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:32.945609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:32.955797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:32.957318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:32.958460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b24665e-0e11-4e75-b950-127fd9dfacf1 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1715 microversion: 2.20 time: 0.165485 Aug 09 12:32:32.959045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 480/953] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:32:32 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:32:35.729973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:35.732260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:35.734661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:35.740272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:35.740786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:35.741252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:35.741941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:35.742395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:35.742818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:35.786449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-be195bd7-b429-4214-aec7-d40d15538db1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060397 Aug 09 12:32:35.787007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 474/954] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:32:35 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:35.929324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:35.929869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:35.936870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:35.937357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:35.937826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:35.938516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:35.938971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:35.939402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:35.968868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e68308ee-2fc3-4715-a613-04971a019fe1 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/05859f2c-f354-4509-b899-302602964347" status: 200 len: 194 microversion: 2.1 time: 0.043504 Aug 09 12:32:35.969443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 481/955] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Aug 9 12:32:35 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/05859f2c-f354-4509-b899-302602964347 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:35.984961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:35.985763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:35.996004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:35.996868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:35.997579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:35.998711 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:35.999662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:36.000114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:36.082131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lazy-loading 'services' on Instance uuid a8c51fe9-e024-4c1b-a62f-605682cf8e14 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:32:36.166329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46efc760-f962-458c-8160-d233a0ea3a2d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/05859f2c-f354-4509-b899-302602964347" status: 202 len: 0 microversion: 2.1 time: 0.187346 Aug 09 12:32:36.166908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 475/956] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:32:35 2022] DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/05859f2c-f354-4509-b899-302602964347 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:32:38.359085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:38.359612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:38.366429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:38.366909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:38.367335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:38.368014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:38.368490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:38.369247 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:38.371564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=88,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:38.400245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6cbc9498-c862-4305-9df6-799837f4df1d tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/8fc1dccf-77ab-41ef-8428-f4ccb3f2b326" status: 200 len: 194 microversion: 2.1 time: 0.045272 Aug 09 12:32:38.400858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 482/957] 10.222.0.60 () {58 vars in 1413 bytes} [Tue Aug 9 12:32:38 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/8fc1dccf-77ab-41ef-8428-f4ccb3f2b326 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:38.413112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:38.413648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:38.420189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:38.420693 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:38.421125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:38.421885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:38.422333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:38.422750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:38.509301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lazy-loading 'services' on Instance uuid a8c51fe9-e024-4c1b-a62f-605682cf8e14 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:32:38.587295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c05acf67-6a9d-4e31-beed-6767fe2555c4 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/8fc1dccf-77ab-41ef-8428-f4ccb3f2b326" status: 202 len: 0 microversion: 2.1 time: 0.179218 Aug 09 12:32:38.587923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 476/958] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:32:38 2022] DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments/8fc1dccf-77ab-41ef-8428-f4ccb3f2b326 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:32:39.773198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:39.775425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:39.782521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:39.782994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:39.783420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:39.784099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:39.784587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:39.785002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:39.813414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8e774e15-7f14-4d9e-83b6-11ab1d6e4f34 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044184 Aug 09 12:32:39.813959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 483/959] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:32:39 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:32:39.946151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:39.949952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:39.957747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:39.958233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:39.958668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:39.959359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:39.959840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:39.960262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:39.989360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-00053b92-c5be-4156-b183-d94d1f47635f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051270 Aug 09 12:32:39.989916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 477/960] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:32:39 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:32:40.052715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:40.053193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:40.059280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:40.059767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:40.060198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:40.060903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:40.061346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:40.061756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:40.087952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:32:40.171464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c66909c4-504e-40a1-9768-1d7d24d07516 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 204 len: 0 microversion: 2.1 time: 0.122375 Aug 09 12:32:40.172067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 484/961] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:32:40 2022] DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:32:40.180854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:40.181459 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:40.187471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:40.188001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:40.188462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:40.189148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:40.189615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:40.190022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:40.322942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:40.334387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-97c34b5f-9519-4f9b-a6a8-4d8ea73bbd7b tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1673 microversion: 2.1 time: 0.157090 Aug 09 12:32:40.335047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 478/962] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:32:40 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:32:41.360924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:41.361724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:41.369518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:41.370041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:41.370523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:41.371284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:41.371774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:41.372235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:41.510110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:41.517922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf289fa6-5b4a-4ed9-b4ec-4476e833c3f8 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1673 microversion: 2.1 time: 0.163980 Aug 09 12:32:41.518489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 485/963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:32:41 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:32:42.543596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:42.544675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:42.552998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:42.553487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:42.553925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:42.554621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:42.555076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:42.555504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:42.692825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:42.700719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7870f108-50f7-45ff-9054-81935bc9737f tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1673 microversion: 2.1 time: 0.163691 Aug 09 12:32:42.701298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 479/964] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:32:42 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:32:43.546269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-623a343b-2a9d-42b6-a11e-377bd46abcb8 req-73a37a17-967a-486b-861b-1246eb19a8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c51fe9-e024-4c1b-a62f-605682cf8e14", "name": "network-vif-deleted", "tag": "f4e3222a-9ec3-4f08-9ef5-8f0b022ad30a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:43.558410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-623a343b-2a9d-42b6-a11e-377bd46abcb8 req-73a37a17-967a-486b-861b-1246eb19a8b5 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:43.558910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-623a343b-2a9d-42b6-a11e-377bd46abcb8 req-73a37a17-967a-486b-861b-1246eb19a8b5 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:43.559356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-623a343b-2a9d-42b6-a11e-377bd46abcb8 req-73a37a17-967a-486b-861b-1246eb19a8b5 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:43.574138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-623a343b-2a9d-42b6-a11e-377bd46abcb8 req-73a37a17-967a-486b-861b-1246eb19a8b5 service nova] Creating event network-vif-deleted:f4e3222a-9ec3-4f08-9ef5-8f0b022ad30a for instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 on hv-cinder-85236 Aug 09 12:32:43.581512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-623a343b-2a9d-42b6-a11e-377bd46abcb8 req-73a37a17-967a-486b-861b-1246eb19a8b5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038724 Aug 09 12:32:43.582713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 486/965] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:43.722150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:43.722758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:43.731920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:43.732435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:43.732875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:43.733772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:43.734391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:43.734981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:43.738485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:43.771647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:43.772131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:43.772607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:43.773290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lazy-loading 'fault' on Instance uuid a8c51fe9-e024-4c1b-a62f-605682cf8e14 {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:32:43.814505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adadf92bd9ec48dfbb4eb5977edab923', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b9057e7d514e6dbe0c358cce79e61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:32:43.822179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4708bd03-e2b1-4569-b40a-7cc4c362fda5 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 200 len: 1328 microversion: 2.1 time: 0.104043 Aug 09 12:32:43.822750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 480/966] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:32:43 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:32:44.848896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:44.850081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:44.861241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:44.861868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:44.862307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:44.863000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:44.863460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:44.863883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:44.877683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] HTTP exception thrown: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Request method failure captured: Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 HTTP/1.1 Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFx8hE73SBt3pj1a8OzySEdx7awttE5mUV3Eu6XFbdytmB-z-Ohp-LMfooJdfMCCe23q7tE8Qog3c80ncT3BiwitvCzEWukANA9IDl8xpNxNiQhTVV1e8r4gK0Zi8ClTzVkXE13Ge-357EtyUyrIKlQSPnQ5THfrEdWy4uL7dD3zqc Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:32:44.879306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: adadf92bd9ec48dfbb4eb5977edab923 Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:44.880815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': 'a8c51fe9-e024-4c1b-a62f-605682cf8e14'} Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:44.883891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:44.885335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:44.886532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Returning 404 to user: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:44.886532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29b629fe-5dc2-4783-a13b-a592f8e2a318 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 404 len: 111 microversion: 2.1 time: 0.039541 Aug 09 12:32:44.886532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 487/967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:32:44 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:32:44.890566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-daaf6c1b-6de3-41a1-b8de-b781a48bf644 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '.version_select at 0x7f0e080f8700>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:44.913058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-daaf6c1b-6de3-41a1-b8de-b781a48bf644 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118231495" status: 202 len: 0 microversion: 2.1 time: 0.026780 Aug 09 12:32:44.913720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 481/968] 10.222.0.60 () {58 vars in 1221 bytes} [Tue Aug 9 12:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118231495 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:32:47.834302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:47.834815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:47.841675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:47.842150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:47.842581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:47.843258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:47.843704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:47.844116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:47.857820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] HTTP exception thrown: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Request method failure captured: Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 HTTP/1.1 Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFx8hE73SBt3pj1a8OzySEdx7awttE5mUV3Eu6XFbdytmB-z-Ohp-LMfooJdfMCCe23q7tE8Qog3c80ncT3BiwitvCzEWukANA9IDl8xpNxNiQhTVV1e8r4gK0Zi8ClTzVkXE13Ge-357EtyUyrIKlQSPnQ5THfrEdWy4uL7dD3zqc Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:32:47.859345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: adadf92bd9ec48dfbb4eb5977edab923 Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.861468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': 'a8c51fe9-e024-4c1b-a62f-605682cf8e14'} Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:47.862418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.863898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.865275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Returning 404 to user: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:47.865275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00d13ba9-b0b4-411f-941f-52db47fe2606 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 404 len: 111 microversion: 2.1 time: 0.030442 Aug 09 12:32:47.865275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 488/969] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:32:47 2022] DELETE /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:32:47.872761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:47.873476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: a8c51fe9-e024-4c1b-a62f-605682cf8e14] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:47.882816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:47.883304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:47.883731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:47.884412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:47.884900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:47.885307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:47.900736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] HTTP exception thrown: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Request method failure captured: Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 HTTP/1.1 Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFx8hE73SBt3pj1a8OzySEdx7awttE5mUV3Eu6XFbdytmB-z-Ohp-LMfooJdfMCCe23q7tE8Qog3c80ncT3BiwitvCzEWukANA9IDl8xpNxNiQhTVV1e8r4gK0Zi8ClTzVkXE13Ge-357EtyUyrIKlQSPnQ5THfrEdWy4uL7dD3zqc Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:32:47.902397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: adadf92bd9ec48dfbb4eb5977edab923 Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.903924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': 'a8c51fe9-e024-4c1b-a62f-605682cf8e14'} Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:47.904788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. Aug 09 12:32:47.906303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:47.907714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Returning 404 to user: Instance a8c51fe9-e024-4c1b-a62f-605682cf8e14 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:47.907714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d9a93b61-d762-4c04-9625-6d378ea65ca0 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14" status: 404 len: 111 microversion: 2.1 time: 0.038225 Aug 09 12:32:47.907714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 482/970] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:32:47 2022] GET /compute/v2.1/servers/a8c51fe9-e024-4c1b-a62f-605682cf8e14 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:32:49.054950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:49.055443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:49.062288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:49.062768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:49.063197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:49.063894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:49.064339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:49.065039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:49.078577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] HTTP exception thrown: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Request method failure captured: Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 HTTP/1.1 Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFx8hE73SBt3pj1a8OzySEdx7awttE5mUV3Eu6XFbdytmB-z-Ohp-LMfooJdfMCCe23q7tE8Qog3c80ncT3BiwitvCzEWukANA9IDl8xpNxNiQhTVV1e8r4gK0Zi8ClTzVkXE13Ge-357EtyUyrIKlQSPnQ5THfrEdWy4uL7dD3zqc Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:32:49.080154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: adadf92bd9ec48dfbb4eb5977edab923 Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.081819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '56388ec4-a642-4d87-a2a1-da60a5c0f9f5'} Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:49.082734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.084271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.085753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Returning 404 to user: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:49.085753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8d38aa07-e689-4aaf-8342-679419c56859 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "DELETE /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 404 len: 111 microversion: 2.1 time: 0.030951 Aug 09 12:32:49.085753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 489/971] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:32:49 2022] DELETE /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:32:49.093396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:49.094087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] [instance: 56388ec4-a642-4d87-a2a1-da60a5c0f9f5] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:49.101657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:49.102144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:49.102576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:49.103273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:49.103728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:49.104156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:49.118564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] HTTP exception thrown: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Request method failure captured: Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 HTTP/1.1 Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFx8hE73SBt3pj1a8OzySEdx7awttE5mUV3Eu6XFbdytmB-z-Ohp-LMfooJdfMCCe23q7tE8Qog3c80ncT3BiwitvCzEWukANA9IDl8xpNxNiQhTVV1e8r4gK0Zi8ClTzVkXE13Ge-357EtyUyrIKlQSPnQ5THfrEdWy4uL7dD3zqc Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:32:49.120537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/47b9057e7d514e6dbe0c358cce79e61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 47b9057e7d514e6dbe0c358cce79e61a Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056239747 Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: adadf92bd9ec48dfbb4eb5977edab923 Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeTestJSON-2056239747-project Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.122121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '56388ec4-a642-4d87-a2a1-da60a5c0f9f5'} Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:49.123005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. Aug 09 12:32:49.124736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:49.126620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] Returning 404 to user: Instance 56388ec4-a642-4d87-a2a1-da60a5c0f9f5 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:49.126620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3a42a128-54ec-470a-9f6d-a29ce59f4be6 tempest-AttachVolumeTestJSON-2056239747 tempest-AttachVolumeTestJSON-2056239747-project] 10.222.0.60 "GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5" status: 404 len: 111 microversion: 2.1 time: 0.035162 Aug 09 12:32:49.126620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 483/972] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:32:49 2022] GET /compute/v2.1/servers/56388ec4-a642-4d87-a2a1-da60a5c0f9f5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:32:51.041571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:51.042202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:51.048890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:51.049363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:51.049898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:51.050589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:51.051238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:51.051665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:51.077405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3d0a31f-36a9-47e1-81eb-661ef4f622b5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/ips" status: 200 len: 150 microversion: 2.1 time: 0.039708 Aug 09 12:32:51.078005 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 490/973] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:32:51 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:52.484903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b17d0ea-15be-42a7-9b14-85588521ab56"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:52.487485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:32:52.495657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:52.495772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:52.496206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:52.497017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:32:52.497504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:32:52.497924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:32:52.807092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71ada180-2504-438f-ad68-f62a1190953b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "POST /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326114 Aug 09 12:32:52.813328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 484/974] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:32:52 2022] POST /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:32:53.723130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15354553-cc8d-4241-ad99-73bc266b3c41 tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Action: 'create', calling method: .version_select at 0x7f0e081fb790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037899517", "metadata": {"Type": "work"}}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15354553-cc8d-4241-ad99-73bc266b3c41 tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Request method failure captured: Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 122 Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lP1gFskubJXxxcwD9hHmzqivAYFLIrZ01mDr7MefuG-vnMoO34PE0G9OfdqsDWalQu8O_S1xCpq_qqZ1O3hjGR8VEYpzP6KTQjd8hD1NR5taxefI3tW-qUVBC8BjZHv28gdW0VzB4HPO6_Bq5a6DyVZoVUzpdvV8_SkMx46-P_QUgk Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:32:53.732406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 3478d947706947c8af42832965e781df Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037899517", "metadata": {"Type": "work"}}} Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: Aug 09 12:32:53.734205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1037899517', 'metadata': {'Type': 'work'}}}} Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise error Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:53.735241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 12:32:53.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 12:32:53.739096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 12:32:53.739096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.739096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15354553-cc8d-4241-ad99-73bc266b3c41 tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:53.739096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15354553-cc8d-4241-ad99-73bc266b3c41 tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.131896 Aug 09 12:32:53.739096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 491/975] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Aug 9 12:32:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:32:53.745881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dab5e0ff-9232-411a-addb-1ed5bc2164fc tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Action: 'create', calling method: .version_select at 0x7f0e083290d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-15741862", "metadata": {"Type": "work"}}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dab5e0ff-9232-411a-addb-1ed5bc2164fc tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Request method failure captured: Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 118 Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lP1gFskubJXxxcwD9hHmzqivAYFLIrZ01mDr7MefuG-vnMoO34PE0G9OfdqsDWalQu8O_S1xCpq_qqZ1O3hjGR8VEYpzP6KTQjd8hD1NR5taxefI3tW-qUVBC8BjZHv28gdW0VzB4HPO6_Bq5a6DyVZoVUzpdvV8_SkMx46-P_QUgk Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:32:53.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 3478d947706947c8af42832965e781df Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-15741862", "metadata": {"Type": "work"}}} Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: Aug 09 12:32:53.752559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-15741862', 'metadata': {'Type': 'work'}}}} Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise error Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi '0' Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:53.754356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 12:32:53.755799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 12:32:53.757580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 12:32:53.757580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.757580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dab5e0ff-9232-411a-addb-1ed5bc2164fc tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:53.757580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dab5e0ff-9232-411a-addb-1ed5bc2164fc tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010962 Aug 09 12:32:53.757580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 485/976] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Aug 9 12:32:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:32:53.762018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b95de7f-1d3b-43c7-90b5-9413eed425ab tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Action: 'create', calling method: .version_select at 0x7f0e0819ee50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1514340511", "metadata": {"Type": "work"}}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b95de7f-1d3b-43c7-90b5-9413eed425ab tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Request method failure captured: Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 119 Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lP1gFskubJXxxcwD9hHmzqivAYFLIrZ01mDr7MefuG-vnMoO34PE0G9OfdqsDWalQu8O_S1xCpq_qqZ1O3hjGR8VEYpzP6KTQjd8hD1NR5taxefI3tW-qUVBC8BjZHv28gdW0VzB4HPO6_Bq5a6DyVZoVUzpdvV8_SkMx46-P_QUgk Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:32:53.766958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 3478d947706947c8af42832965e781df Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1514340511", "metadata": {"Type": "work"}}} Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: Aug 09 12:32:53.769129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1514340511', 'metadata': {'Type': 'work'}}}} Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise error Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi '' Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:53.770621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 12:32:53.772432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 12:32:53.774258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 12:32:53.774258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.774258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b95de7f-1d3b-43c7-90b5-9413eed425ab tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:53.774258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9b95de7f-1d3b-43c7-90b5-9413eed425ab tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010496 Aug 09 12:32:53.774258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 492/977] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Aug 9 12:32:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:32:53.780306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bf389629-727e-4ecf-82dd-968559e8958c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Calling method '.version_select at 0x7f0e081b6ca0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:53.812197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-bf389629-727e-4ecf-82dd-968559e8958c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] HTTP exception thrown: Volume tempest-invalid-1348605990 could not be found. Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bf389629-727e-4ecf-82dd-968559e8958c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Request method failure captured: Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1348605990 HTTP/1.1 Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lP1gFskubJXxxcwD9hHmzqivAYFLIrZ01mDr7MefuG-vnMoO34PE0G9OfdqsDWalQu8O_S1xCpq_qqZ1O3hjGR8VEYpzP6KTQjd8hD1NR5taxefI3tW-qUVBC8BjZHv28gdW0VzB4HPO6_Bq5a6DyVZoVUzpdvV8_SkMx46-P_QUgk Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:32:53.814301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 3478d947706947c8af42832965e781df Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Volume tempest-invalid-1348605990 could not be found. Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': 'tempest-invalid-1348605990'} Aug 09 12:32:53.815906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1348605990 could not be found. (HTTP 404) (Request-ID: req-d606bbdb-6b1f-4ddc-b3e1-0213f7979e6e) Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.816883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 12:32:53.818145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1348605990 could not be found. Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:32:53.819333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1348605990 could not be found. Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1348605990 could not be found. Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bf389629-727e-4ecf-82dd-968559e8958c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Returning 404 to user: Volume tempest-invalid-1348605990 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bf389629-727e-4ecf-82dd-968559e8958c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1348605990" status: 404 len: 99 microversion: 2.1 time: 0.039959 Aug 09 12:32:53.820974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 486/978] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Aug 9 12:32:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1348605990 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 12:32:53.825692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e249c886-50d7-436a-9aef-ddb675349de2 tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003917 Aug 09 12:32:53.826317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 493/979] 10.222.0.60 () {58 vars in 1140 bytes} [Tue Aug 9 12:32:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 12:32:53.836511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d1930483-36bd-4c07-9f11-73aae0d2724e tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003901 Aug 09 12:32:53.837101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 487/980] 10.222.0.60 () {58 vars in 1137 bytes} [Tue Aug 9 12:32:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 12:32:53.845767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b67d0727-c991-467b-8b6b-bc4e4be7700c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Calling method '.version_select at 0x7f0e082b44c0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:53.878668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-b67d0727-c991-467b-8b6b-bc4e4be7700c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] HTTP exception thrown: Volume e739fbc4-ea1f-45d4-84a2-2f189b086b42 could not be found. Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b67d0727-c991-467b-8b6b-bc4e4be7700c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Request method failure captured: Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/os-volumes/e739fbc4-ea1f-45d4-84a2-2f189b086b42 HTTP/1.1 Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lP1gFskubJXxxcwD9hHmzqivAYFLIrZ01mDr7MefuG-vnMoO34PE0G9OfdqsDWalQu8O_S1xCpq_qqZ1O3hjGR8VEYpzP6KTQjd8hD1NR5taxefI3tW-qUVBC8BjZHv28gdW0VzB4HPO6_Bq5a6DyVZoVUzpdvV8_SkMx46-P_QUgk Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:32:53.880614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 3478d947706947c8af42832965e781df Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Volume e739fbc4-ea1f-45d4-84a2-2f189b086b42 could not be found. Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': 'e739fbc4-ea1f-45d4-84a2-2f189b086b42'} Aug 09 12:32:53.882004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e739fbc4-ea1f-45d4-84a2-2f189b086b42 could not be found. (HTTP 404) (Request-ID: req-cd57239c-6991-4b19-96dd-4d24402c9f8c) Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.882836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 12:32:53.884016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e739fbc4-ea1f-45d4-84a2-2f189b086b42 could not be found. Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 12:32:53.888021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e739fbc4-ea1f-45d4-84a2-2f189b086b42 could not be found. Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e739fbc4-ea1f-45d4-84a2-2f189b086b42 could not be found. Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b67d0727-c991-467b-8b6b-bc4e4be7700c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Returning 404 to user: Volume e739fbc4-ea1f-45d4-84a2-2f189b086b42 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b67d0727-c991-467b-8b6b-bc4e4be7700c tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/e739fbc4-ea1f-45d4-84a2-2f189b086b42" status: 404 len: 109 microversion: 2.1 time: 0.040082 Aug 09 12:32:53.890392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 494/981] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:32:53 2022] DELETE /compute/v2.1/os-volumes/e739fbc4-ea1f-45d4-84a2-2f189b086b42 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 12:32:53.903150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-155ab5e6-c73f-49dc-a13d-93f76380c52f tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Calling method '.version_select at 0x7f0e08329ee0>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-155ab5e6-c73f-49dc-a13d-93f76380c52f tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] HTTP exception thrown: Volume 05ab6686-00ba-4222-8abe-4d98442b4482 could not be found. Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-155ab5e6-c73f-49dc-a13d-93f76380c52f tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Request method failure captured: Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/os-volumes/05ab6686-00ba-4222-8abe-4d98442b4482 HTTP/1.1 Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lP1gFskubJXxxcwD9hHmzqivAYFLIrZ01mDr7MefuG-vnMoO34PE0G9OfdqsDWalQu8O_S1xCpq_qqZ1O3hjGR8VEYpzP6KTQjd8hD1NR5taxefI3tW-qUVBC8BjZHv28gdW0VzB4HPO6_Bq5a6DyVZoVUzpdvV8_SkMx46-P_QUgk Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:32:53.936588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/5449f07abd99492aa8c1a2d4b1cf4529"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 5449f07abd99492aa8c1a2d4b1cf4529 Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesNegativeTest-770078034 Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 3478d947706947c8af42832965e781df Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesNegativeTest-770078034-project Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Volume 05ab6686-00ba-4222-8abe-4d98442b4482 could not be found. Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '05ab6686-00ba-4222-8abe-4d98442b4482'} Aug 09 12:32:53.938211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05ab6686-00ba-4222-8abe-4d98442b4482 could not be found. (HTTP 404) (Request-ID: req-f756f8bb-a00f-4f28-9730-ba21d6df4992) Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:32:53.941427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05ab6686-00ba-4222-8abe-4d98442b4482 could not be found. Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 12:32:53.943417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05ab6686-00ba-4222-8abe-4d98442b4482 could not be found. Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05ab6686-00ba-4222-8abe-4d98442b4482 could not be found. Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-155ab5e6-c73f-49dc-a13d-93f76380c52f tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] Returning 404 to user: Volume 05ab6686-00ba-4222-8abe-4d98442b4482 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-155ab5e6-c73f-49dc-a13d-93f76380c52f tempest-VolumesNegativeTest-770078034 tempest-VolumesNegativeTest-770078034-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/05ab6686-00ba-4222-8abe-4d98442b4482" status: 404 len: 109 microversion: 2.1 time: 0.041857 Aug 09 12:32:53.945191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 488/982] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:32:53 2022] GET /compute/v2.1/os-volumes/05ab6686-00ba-4222-8abe-4d98442b4482 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:33:00.500103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:00.501038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:00.508304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:00.508815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:00.509241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:00.509932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:00.510363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:00.510861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:00.594492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lazy-loading 'services' on Instance uuid 291aa64f-9bc8-4e3d-8d9b-791feda19838 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:33:00.670603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46139716-d114-4b3c-b2d0-a69a8c239a03 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments/8b17d0ea-15be-42a7-9b14-85588521ab56" status: 202 len: 0 microversion: 2.1 time: 0.175468 Aug 09 12:33:00.675302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 495/983] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:33:00 2022] DELETE /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments/8b17d0ea-15be-42a7-9b14-85588521ab56 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:33:00.683083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:00.685498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:00.693561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:00.694038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:00.694514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:00.695208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:00.695722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:00.696190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:00.728921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6a962007-3bc4-4c96-a4b1-8d199430edbf tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051894 Aug 09 12:33:00.729491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 489/984] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:33:00 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:01.742088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:01.744891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:01.751475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:01.751966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:01.752408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:01.753224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:01.753680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:01.754092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:01.788794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ae63b9af-854b-4848-8392-2cbe4cfa1610 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051027 Aug 09 12:33:01.789376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 496/985] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:33:01 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:02.804205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:02.806410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:02.813027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:02.813516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:02.813948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:02.814643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:02.815092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:02.815545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:02.845018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c7b4ab7-0084-40f2-9467-c81aacbcd838 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 Aug 09 12:33:02.845559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 490/986] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:33:02 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:03.861224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:03.864817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:03.868963 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:03.877584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:03.878591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:03.879032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:03.879732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:03.880178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:03.880633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:03.911498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8549e563-c24c-455a-93ed-43d20d872bd5 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057185 Aug 09 12:33:03.912053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 497/987] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:33:03 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:04.923256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:04.925565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:04.932622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:04.933103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:04.933524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:04.934217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:04.934660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:04.935048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:04.959472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1274466851", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-898829135", "security_groups": [{"name": "tempest-secgroup-smoke-1174931768"}], "block_device_mapping_v2": [{"uuid": "f9578305-6010-4398-95ef-447e5d7f2032", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6b924274-f01a-4354-a302-f155f90252c3"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:04.964829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3fd718fc-bd00-4e64-ab6f-4bc72dbb02fc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045531 Aug 09 12:33:04.965561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 491/988] 10.222.0.60 () {58 vars in 1302 bytes} [Tue Aug 9 12:33:04 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 12:33:05.029649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:05.030144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:05.036329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:05.036869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:05.037295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:05.038028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:05.038694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:05.039109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:05.064553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:33:05.076723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] validate_networks() for [('6b924274-f01a-4354-a302-f155f90252c3', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:33:05.145593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-28dc73f6-826f-4155-9b23-0c718d04cb1c tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 204 len: 0 microversion: 2.1 time: 0.119343 Aug 09 12:33:05.146347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 492/989] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:33:05 2022] DELETE /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:33:05.155160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:05.155846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:05.162840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:05.163362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:05.163804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:05.164551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:05.165007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:05.165433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:05.375144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:05.383548 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3cc6ca5-8e3b-4282-a62a-51b371c4782b tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1681 microversion: 2.1 time: 0.232278 Aug 09 12:33:05.396402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 493/990] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:05 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:05.547539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:33:05.548057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:33:05.548633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:33:05.549114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:33:05.549657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:33:05.559050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:05.559609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:05.560081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:05.560910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:05.561362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:05.561777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:05.582327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Getting quotas for project 602ad89c70da4ace9856766be19815a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:33:05.586989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Getting quotas for user 50fa6727271142eba979bb4562a2b853 and project 602ad89c70da4ace9856766be19815a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:33:05.646776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:33:05.649040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9578305-6010-4398-95ef-447e5d7f2032',volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:33:05.786720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7f7e6325-ef4f-495f-9edb-3b46481321ec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831898 Aug 09 12:33:05.787501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 498/991] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:33:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:33:05.805997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-12b57651-654d-48f9-b685-9de2c01706d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:05.806881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-12b57651-654d-48f9-b685-9de2c01706d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:05.809148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:05.877288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-12b57651-654d-48f9-b685-9de2c01706d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:05.884243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-12b57651-654d-48f9-b685-9de2c01706d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1094 microversion: 2.1 time: 0.089249 Aug 09 12:33:05.885038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 494/992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:05 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:06.411145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:06.412220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:06.423750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:06.424643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:06.425359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:06.426584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:06.427082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:06.427726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:06.578835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:06.587842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f6b9a9b-dc73-4ff1-b536-3973d5880222 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1681 microversion: 2.1 time: 0.184276 Aug 09 12:33:06.588798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 499/993] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:06 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:06.906055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:06.906774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:06.914954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:06.915079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:06.915460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:06.916147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:06.917076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:06.917076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:06.979093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:06.986837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-91e030d8-38bc-4a83-91a9-fe4eafac534f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1192 microversion: 2.1 time: 0.085620 Aug 09 12:33:06.987521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 495/994] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:06 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:07.611239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:07.611877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:07.619291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:07.619791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:07.620248 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:07.621001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:07.621471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:07.621901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:07.869357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:07.881422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-60c7b705-4680-41a7-9e8f-9c41f4357471 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1681 microversion: 2.1 time: 0.274104 Aug 09 12:33:07.882764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 500/995] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:07 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1681 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:08.008099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:08.009160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:08.015377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:08.016076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:08.016764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:08.017469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:08.017921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:08.018314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:08.092963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:08.102975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-97b0fd34-d20c-420c-a5b8-9ff7307889fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1210 microversion: 2.1 time: 0.098752 Aug 09 12:33:08.118882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 496/996] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:08 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1210 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:08.674441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-4db6f45f-09e8-4817-b047-e61f837bec39 req-d078ba59-e1b0-4c10-adec-22b6bd4369a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291aa64f-9bc8-4e3d-8d9b-791feda19838", "name": "network-vif-deleted", "tag": "48b13038-6ce6-4b9f-a44a-dfce61e4f322"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:08.706165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4db6f45f-09e8-4817-b047-e61f837bec39 req-d078ba59-e1b0-4c10-adec-22b6bd4369a7 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:08.707644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4db6f45f-09e8-4817-b047-e61f837bec39 req-d078ba59-e1b0-4c10-adec-22b6bd4369a7 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:08.709814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4db6f45f-09e8-4817-b047-e61f837bec39 req-d078ba59-e1b0-4c10-adec-22b6bd4369a7 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:08.745839 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-4db6f45f-09e8-4817-b047-e61f837bec39 req-d078ba59-e1b0-4c10-adec-22b6bd4369a7 service nova] Creating event network-vif-deleted:48b13038-6ce6-4b9f-a44a-dfce61e4f322 for instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 on hv-cinder-85236 Aug 09 12:33:08.759275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-4db6f45f-09e8-4817-b047-e61f837bec39 req-d078ba59-e1b0-4c10-adec-22b6bd4369a7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089571 Aug 09 12:33:08.766282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 501/997] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:08.909020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:08.909730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:08.916708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:08.917804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:08.918405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:08.919293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:08.919921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:08.920556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:09.039386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982b93df5744bbbdeb7a956df06502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cffa9ae943de44bc8264914e39c80cfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:09.052127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3282bd2-61ef-4784-a51a-33203105571f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 200 len: 1326 microversion: 2.1 time: 0.152658 Aug 09 12:33:09.053128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 497/998] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:08 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 1326 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:33:09.126547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:09.127169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:09.133999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:09.134555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:09.135003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:09.136529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:09.136995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:09.137424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:09.379609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:09.388691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-abd03b9d-fa5c-4e2a-80bc-02a42d1be97c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.267017 Aug 09 12:33:09.401508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 502/999] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:09 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:09.475320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-4b0d5e67-6339-4d22-8b86-5b60dfb624cb req-7b873b3d-da7d-4860-9318-4d4813529956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091", "tag": "360d1d5b-897e-40a1-93d7-e97dbff856e7"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:09.491803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4b0d5e67-6339-4d22-8b86-5b60dfb624cb req-7b873b3d-da7d-4860-9318-4d4813529956 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:09.492504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4b0d5e67-6339-4d22-8b86-5b60dfb624cb req-7b873b3d-da7d-4860-9318-4d4813529956 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:09.493027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-4b0d5e67-6339-4d22-8b86-5b60dfb624cb req-7b873b3d-da7d-4860-9318-4d4813529956 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:09.511804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-4b0d5e67-6339-4d22-8b86-5b60dfb624cb req-7b873b3d-da7d-4860-9318-4d4813529956 service nova] Creating event network-changed:360d1d5b-897e-40a1-93d7-e97dbff856e7 for instance f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 on hv-cinder-85236 Aug 09 12:33:09.520269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-4b0d5e67-6339-4d22-8b86-5b60dfb624cb req-7b873b3d-da7d-4860-9318-4d4813529956 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055145 Aug 09 12:33:09.523131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 498/1000] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:10.075642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:10.076323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:10.083251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:10.084083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:10.084400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:10.085122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:10.085582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:10.086008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:10.090404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:10.101556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 HTTP/1.1 Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:33:10.103539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:10.105261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '291aa64f-9bc8-4e3d-8d9b-791feda19838'} Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:10.106368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:10.107879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:10.110409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:10.111483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-96bf52ee-ac0e-4ff8-81cc-f03f0741eace tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 404 len: 111 microversion: 2.1 time: 0.040473 Aug 09 12:33:10.112053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 503/1001] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:10 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:33:10.121603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0606eaad-a5fd-4610-bf01-2acbf94f1961 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '.version_select at 0x7f0e082b1f70>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:10.142061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0606eaad-a5fd-4610-bf01-2acbf94f1961 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178459495" status: 202 len: 0 microversion: 2.1 time: 0.024992 Aug 09 12:33:10.142656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 499/1002] 10.222.0.60 () {58 vars in 1218 bytes} [Tue Aug 9 12:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178459495 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 12:33:10.411885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:10.412419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:10.418885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:10.419372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:10.419806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:10.420540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:10.420990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:10.421403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:10.654120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:10.662002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c1c37e7c-6da2-4c01-a396-59eb0bf94beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.254458 Aug 09 12:33:10.662499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 504/1003] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:10 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:11.685670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:11.686471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:11.694946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:11.695539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:11.696055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:11.696953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:11.697502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:11.697989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:11.930182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:11.938127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0b16fd30-fcdb-40e3-85f4-e0379119f99e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.258221 Aug 09 12:33:11.938779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 500/1004] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:11 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:12.027614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:12.028193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:12.034762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:12.035330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:12.035833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:12.036737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:12.037262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:12.037751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:12.053102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 HTTP/1.1 Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:33:12.054662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.056344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '291aa64f-9bc8-4e3d-8d9b-791feda19838'} Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:12.057319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.058895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.060555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:12.060555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db559330-a413-46c1-9043-ac39931a086a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 404 len: 111 microversion: 2.1 time: 0.032410 Aug 09 12:33:12.060555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 505/1005] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:33:12 2022] DELETE /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:33:12.064770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:12.065313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 291aa64f-9bc8-4e3d-8d9b-791feda19838] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:12.072038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:12.072549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:12.072974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:12.073663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:12.074108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:12.074520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:12.089935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 HTTP/1.1 Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:33:12.091609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.093272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '291aa64f-9bc8-4e3d-8d9b-791feda19838'} Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:12.094175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. Aug 09 12:33:12.095476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:12.096683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 291aa64f-9bc8-4e3d-8d9b-791feda19838 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:12.096683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eb89b3a3-14f7-4399-9734-11801c68197a tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838" status: 404 len: 111 microversion: 2.1 time: 0.032598 Aug 09 12:33:12.096683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 501/1006] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:12 2022] GET /compute/v2.1/servers/291aa64f-9bc8-4e3d-8d9b-791feda19838 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 12:33:12.959699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:12.960304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:12.966996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:12.967501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:12.967962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:12.968693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:12.969138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:12.969535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.109075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:13.116783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed0291f2-d5ed-4e20-bdfe-5e8e496c5fd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.161273 Aug 09 12:33:13.117338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 506/1007] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:12 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:13.254358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:13.254857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:13.261999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:13.262471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:13.262900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.263582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:13.264025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:13.264488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.278213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 HTTP/1.1 Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:33:13.279761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.281325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '8ca3852b-60ed-4fdd-92fc-ff09275d22f7'} Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:13.282236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.283768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.285319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:13.285319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2aabbefc-5f1a-4c0f-91c0-bbb59ba7bbfc tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 404 len: 111 microversion: 2.1 time: 0.030688 Aug 09 12:33:13.285319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 502/1008] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:33:13 2022] DELETE /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:33:13.289829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:13.290429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 8ca3852b-60ed-4fdd-92fc-ff09275d22f7] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:13.296746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:13.297221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:13.297642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.298324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:13.298773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:13.299176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.312623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 HTTP/1.1 Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:33:13.314152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.315730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '8ca3852b-60ed-4fdd-92fc-ff09275d22f7'} Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:13.316745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. Aug 09 12:33:13.319135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.320486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 8ca3852b-60ed-4fdd-92fc-ff09275d22f7 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:13.320486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1257536-0781-4c2c-ad45-8f340754a4b8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7" status: 404 len: 111 microversion: 2.1 time: 0.029587 Aug 09 12:33:13.320486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 507/1009] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:13 2022] GET /compute/v2.1/servers/8ca3852b-60ed-4fdd-92fc-ff09275d22f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:33:13.323926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:13.324420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:13.330493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:13.330961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:13.331388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.332065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:13.332542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:13.332980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.349638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 HTTP/1.1 Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:33:13.351183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.352829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '566853b6-ba9c-4357-a910-7ddddde30496'} Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:13.354155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.355641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.357415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:13.357415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-236cf3fe-55f6-4e2e-a3d2-2e69c2f837f8 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 404 len: 111 microversion: 2.1 time: 0.032468 Aug 09 12:33:13.357415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 503/1010] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:33:13 2022] DELETE /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 12:33:13.361273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:13.361907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: 566853b6-ba9c-4357-a910-7ddddde30496] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:13.368411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:13.369244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:13.369669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.370345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:13.370795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:13.371202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:13.384476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 HTTP/1.1 Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:33:13.385967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.387492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '566853b6-ba9c-4357-a910-7ddddde30496'} Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:13.388531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. Aug 09 12:33:13.389991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:13.391383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance 566853b6-ba9c-4357-a910-7ddddde30496 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:13.391383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e59ff907-2007-4c9d-a555-9a83ea2b988f tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496" status: 404 len: 111 microversion: 2.1 time: 0.030003 Aug 09 12:33:13.391383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 508/1011] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:13 2022] GET /compute/v2.1/servers/566853b6-ba9c-4357-a910-7ddddde30496 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:33:14.137864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:14.138486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:14.145100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:14.145565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:14.145991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:14.146815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:14.147265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:14.147679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:14.150301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:14.287650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:14.295761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e00bdca7-f718-4c9a-b9af-d6cf0fb290d5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.161881 Aug 09 12:33:14.296325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 504/1012] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:14 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:14.547531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:14.548029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:14.555061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:14.555541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:14.555973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:14.556699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:14.557154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:14.557575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:14.571282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 HTTP/1.1 Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:33:14.572879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.574453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': 'f547825d-c0f5-40e7-8788-3a519b56ae51'} Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:14.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.576992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.578536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:14.578536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1fb550e-3f95-46db-acb3-a27f8e2df6bb tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 404 len: 111 microversion: 2.1 time: 0.030587 Aug 09 12:33:14.578536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 509/1013] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:33:14 2022] DELETE /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:33:14.583372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:14.584639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] [instance: f547825d-c0f5-40e7-8788-3a519b56ae51] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:14.590996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:14.591478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:14.591911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:14.592646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:14.593099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:14.593520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:14.607509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] HTTP exception thrown: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Request method failure captured: Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 HTTP/1.1 Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lFsV9g5mzQBWbHJX5XDs4-c51Pu0rwj1dVsKvWSrjEbX2VLr-tRGvaKK3ADlB6iVw3dIZhVayoe5RxJX9JPHBzwMiQ6ha64_5-fgwdnwjHddMHPu0YUKDU0gvGJAe8iV9FvB6x1t-Sr0SdgrYJNoKvNLmI7JmsoPKIs3AJ5FzOJXJM Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:33:14.609101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cffa9ae943de44bc8264914e39c80cfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: cffa9ae943de44bc8264914e39c80cfa Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1052262029 Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: c8982b93df5744bbbdeb7a956df06502 Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeNegativeTest-1052262029-project Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.610781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': 'f547825d-c0f5-40e7-8788-3a519b56ae51'} Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:14.611851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. Aug 09 12:33:14.613341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:14.615064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] Returning 404 to user: Instance f547825d-c0f5-40e7-8788-3a519b56ae51 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:14.615064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c1f8ea64-240c-40f7-8c23-5c2cb05e1de7 tempest-AttachVolumeNegativeTest-1052262029 tempest-AttachVolumeNegativeTest-1052262029-project] 10.222.0.60 "GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51" status: 404 len: 111 microversion: 2.1 time: 0.031159 Aug 09 12:33:14.615064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 505/1014] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:14 2022] GET /compute/v2.1/servers/f547825d-c0f5-40e7-8788-3a519b56ae51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:33:15.325271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:15.326020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:15.332244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:15.332961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:15.333393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:15.334106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:15.334548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:15.335224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:15.572279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:15.594212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:15.682879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:15.690806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e253cadd-2521-4107-85a5-db332ae2f062 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.369575 Aug 09 12:33:15.691488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 510/1015] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:15 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:16.712527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:16.713434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:16.718051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:16.726960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:16.727437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:16.727917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:16.733051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:16.733736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:16.734365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:16.923349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:16.931376 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5fe49793-5ea8-4070-bfdf-127ca16c8ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.223837 Aug 09 12:33:16.931950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 506/1016] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:16 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:17.952695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:17.953494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:17.961249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:17.961744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:17.962182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:17.962897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:17.963350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:17.963772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:18.489650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:18.499772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-55ab0492-5edf-4857-a4eb-215da7f6d96d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.551382 Aug 09 12:33:18.508747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 511/1017] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:17 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:33:19.528952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:19.530517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:19.539839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:19.540958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:19.541596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:19.542584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:19.543248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:19.543871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:19.721177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:19.731496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5ee1aaa9-90b0-4267-9496-7a8498743a8e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.206833 Aug 09 12:33:19.732482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 507/1018] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:19 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:20.752551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:20.753223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:20.759903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:20.760308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:20.760966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:20.761656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:20.762179 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:20.762506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:20.907408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:20.915368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1277d096-bba5-4cdb-8375-91780502e7b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.166723 Aug 09 12:33:20.916210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 512/1019] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:20 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:33:21.603583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-93b9f3ad-9ed8-43b9-bcb4-1dbb42b102f8 req-82dd5c40-c92a-4e86-8418-684c142c0874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091", "name": "network-vif-plugged", "status": "completed", "tag": "360d1d5b-897e-40a1-93d7-e97dbff856e7"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:21.613003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-93b9f3ad-9ed8-43b9-bcb4-1dbb42b102f8 req-82dd5c40-c92a-4e86-8418-684c142c0874 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:21.613486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-93b9f3ad-9ed8-43b9-bcb4-1dbb42b102f8 req-82dd5c40-c92a-4e86-8418-684c142c0874 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:21.613897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-93b9f3ad-9ed8-43b9-bcb4-1dbb42b102f8 req-82dd5c40-c92a-4e86-8418-684c142c0874 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:21.625555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-93b9f3ad-9ed8-43b9-bcb4-1dbb42b102f8 req-82dd5c40-c92a-4e86-8418-684c142c0874 service nova] Creating event network-vif-plugged:360d1d5b-897e-40a1-93d7-e97dbff856e7 for instance f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 on hv-cinder-85236 Aug 09 12:33:21.630596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-93b9f3ad-9ed8-43b9-bcb4-1dbb42b102f8 req-82dd5c40-c92a-4e86-8418-684c142c0874 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162943 Aug 09 12:33:21.631403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 508/1020] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:21.936952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:21.937672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:21.945166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:21.945920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:21.946460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:21.947254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:21.947804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:21.948326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:22.089699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:22.097525 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4dea763b-5c03-4cad-98b2-0ffde8a66bd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.165423 Aug 09 12:33:22.098095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 513/1021] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:21 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:23.122252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:23.122978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:23.130627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:23.131119 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:23.131554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:23.132253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:23.132870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:23.133575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:23.277313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:23.285109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6f0e2ff5-a6d3-4de9-8966-36b049f7c057 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1266 microversion: 2.1 time: 0.168830 Aug 09 12:33:23.285715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 509/1022] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:23 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:24.306732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:24.307988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:24.314079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:24.314556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:24.314983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:24.315687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:24.316114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:24.316738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:24.461711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:24.469523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2e36a634-f0e1-4e9c-aba3-db75b131e335 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1453 microversion: 2.1 time: 0.166719 Aug 09 12:33:24.470398 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 514/1023] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:24 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:24.491122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:24.492653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:24.499698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:24.500322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:24.500858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:24.501794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:24.502681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:24.503111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:24.709583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:24.717474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-744fce33-18f5-4af0-bd3b-88aa3eefa73c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1453 microversion: 2.1 time: 0.231236 Aug 09 12:33:24.718138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 510/1024] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:24 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1453 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:33:26.906630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-936c7e56-a39c-4919-9990-3430d3c8c3ed req-1814126f-5704-4585-bade-c02092a012c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091", "tag": "360d1d5b-897e-40a1-93d7-e97dbff856e7"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:26.917369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-936c7e56-a39c-4919-9990-3430d3c8c3ed req-1814126f-5704-4585-bade-c02092a012c9 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:26.917951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-936c7e56-a39c-4919-9990-3430d3c8c3ed req-1814126f-5704-4585-bade-c02092a012c9 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:26.918412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-936c7e56-a39c-4919-9990-3430d3c8c3ed req-1814126f-5704-4585-bade-c02092a012c9 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:26.930259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-936c7e56-a39c-4919-9990-3430d3c8c3ed req-1814126f-5704-4585-bade-c02092a012c9 service nova] Creating event network-changed:360d1d5b-897e-40a1-93d7-e97dbff856e7 for instance f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 on hv-cinder-85236 Aug 09 12:33:26.936157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-936c7e56-a39c-4919-9990-3430d3c8c3ed req-1814126f-5704-4585-bade-c02092a012c9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033222 Aug 09 12:33:26.937283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 515/1025] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:39.656565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2020431848", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "networks": [{"uuid": "813d1549-babb-4fe4-8e58-2d6e8b0131c5"}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:39.665061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:39.665809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=33 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:39.716348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] validate_networks() for [('813d1549-babb-4fe4-8e58-2d6e8b0131c5', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:33:40.275293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:33:40.275913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:33:40.276407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:33:40.277080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:33:40.277491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:33:40.287330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:40.288760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:40.289193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:40.301426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:40.301906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:40.302335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:40.326113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Getting quotas for project e57ead005fcd46e4a751225d11d4f9e1. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:33:40.330020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Getting quotas for user 1c6c4f7d2e6e42b38368cf3eaffc6187 and project e57ead005fcd46e4a751225d11d4f9e1. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:33:40.340831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:33:40.343325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:33:40.390918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2066e33d-7978-4149-87b5-9c9c8df597bf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738488 Aug 09 12:33:40.391756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 511/1026] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:33:40.400638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:40.402014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=53 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:40.407019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d20cff84-a30f-44af-ac93-980cdb63dab9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:40.407724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d20cff84-a30f-44af-ac93-980cdb63dab9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:40.481574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d20cff84-a30f-44af-ac93-980cdb63dab9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:40.488807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d20cff84-a30f-44af-ac93-980cdb63dab9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1219 microversion: 2.1 time: 0.089853 Aug 09 12:33:40.489429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 516/1027] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:40 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:33:41.513357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:41.513936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:41.522652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:41.523427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:41.523860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:41.524585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:41.525027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:41.525488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:41.634535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:41.648659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-50863165-2c75-4c6b-a74d-57172a7221e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1279 microversion: 2.1 time: 0.142001 Aug 09 12:33:41.649767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 512/1028] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:41 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:42.672470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:42.673241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:42.684196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:42.685059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:42.685637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:42.686712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:42.687367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:42.687969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:42.919034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:42.927001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9d35216f-f384-433d-b26e-e92d34634679 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.259301 Aug 09 12:33:42.927656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 517/1029] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:42 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:43.182208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-c5a5c974-f2cb-418a-b1b8-888a15b8c516 req-82830082-c594-40f8-8ece-97bdb57a5441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e522aa4-f477-478c-9f4c-39e0c4202b36", "tag": "aaa1a38f-9266-45a9-a223-7009cbc288e0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:43.191791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c5a5c974-f2cb-418a-b1b8-888a15b8c516 req-82830082-c594-40f8-8ece-97bdb57a5441 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:43.192267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c5a5c974-f2cb-418a-b1b8-888a15b8c516 req-82830082-c594-40f8-8ece-97bdb57a5441 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:43.192723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-c5a5c974-f2cb-418a-b1b8-888a15b8c516 req-82830082-c594-40f8-8ece-97bdb57a5441 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:43.203619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-c5a5c974-f2cb-418a-b1b8-888a15b8c516 req-82830082-c594-40f8-8ece-97bdb57a5441 service nova] Creating event network-changed:aaa1a38f-9266-45a9-a223-7009cbc288e0 for instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 on hv-cinder-85236 Aug 09 12:33:43.208704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-c5a5c974-f2cb-418a-b1b8-888a15b8c516 req-82830082-c594-40f8-8ece-97bdb57a5441 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169678 Aug 09 12:33:43.209260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 513/1030] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:43.437419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-375614894", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "networks": [{"uuid": "92679a07-cfb0-4c70-bb12-48874d80f9ac"}]}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:43.493996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] validate_networks() for [('92679a07-cfb0-4c70-bb12-48874d80f9ac', None, None, None, None, None)] {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:33:43.858712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:33:43.859312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:33:43.859589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:33:43.859993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:33:43.860421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:33:43.870204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:43.870803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:43.871237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:43.871978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:43.872423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:43.872869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:43.890944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Getting quotas for project f461ddd7986842159c8e8177a7825435. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:33:43.895394 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Getting quotas for user e9f9a02ea89f4991a3042c14cf869432 and project f461ddd7986842159c8e8177a7825435. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:33:43.907324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:33:43.909682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:33:43.950302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:43.950982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:43.957243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:43.957728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:43.958162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:43.958383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b6d0d678-8d38-416a-98f3-820774e50666 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525501 Aug 09 12:33:43.958855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:43.959209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 518/1031] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:33:43.959777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:43.960270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:43.970527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45074f77-46ed-4755-ba40-5c9a7d1f69aa tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:43.971128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45074f77-46ed-4755-ba40-5c9a7d1f69aa tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:44.034707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45074f77-46ed-4755-ba40-5c9a7d1f69aa tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:44.044315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45074f77-46ed-4755-ba40-5c9a7d1f69aa tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1213 microversion: 2.1 time: 0.077737 Aug 09 12:33:44.045189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 519/1032] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:43 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:33:44.123395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:44.130904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-987b23c2-1d33-451a-b350-397caa207d6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.185428 Aug 09 12:33:44.131467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 514/1033] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:43 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:33:45.069191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:45.070201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:45.081326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:45.082827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:45.083552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:45.084814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:45.085571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:45.086269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:45.151412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:45.151886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:45.152018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:45.159148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:45.159633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:45.159753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-68755470-b589-4b2b-865a-4ff298048946 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1217 microversion: 2.1 time: 0.097165 Aug 09 12:33:45.160065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:45.160335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 520/1034] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:45 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:45.160792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:45.161241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:45.161649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:45.299071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:45.311121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4568dcde-e956-41c3-8868-fe821145f05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.163389 Aug 09 12:33:45.311891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 515/1035] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:45 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:46.180435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:46.181284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:46.192171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:46.193048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:46.193585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:46.194344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:46.194868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:46.195286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:46.267575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:46.275190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e625c75-9bb5-441b-961e-9f9b012ed3f4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1265 microversion: 2.1 time: 0.098735 Aug 09 12:33:46.275757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 521/1036] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:46 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:46.339210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:46.339801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:46.350176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:46.350861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:46.351484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:46.352472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:46.353171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:46.353720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:46.537903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:46.545725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-738f0a13-a4d2-4def-b441-565d878c63a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.212342 Aug 09 12:33:46.547455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 516/1037] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:46 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:47.296331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:47.297263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:47.304071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:47.304574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:47.305027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:47.305671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:47.306135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:47.306547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:47.439079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:47.447161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-90323210-406f-4067-9055-2ec75dd6db72 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.154750 Aug 09 12:33:47.447935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 522/1038] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:47 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:47.567917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:47.569295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:47.580515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:47.581282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:47.581932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:47.582759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:47.584263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:47.584957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:47.733375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:47.743335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ad238535-6b34-482e-ad06-270318476b01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.179878 Aug 09 12:33:47.743895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 517/1039] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:47 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:48.002294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-4325045d-eab5-497c-b97c-1f4090017838 req-8a3e855c-a992-4015-9d0a-5d9ea243c98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47789853-d310-42ed-81c5-3006cec1272f", "tag": "85921f59-194d-4e06-a860-533aed7cda88"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:48.012327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4325045d-eab5-497c-b97c-1f4090017838 req-8a3e855c-a992-4015-9d0a-5d9ea243c98f service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:48.012864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4325045d-eab5-497c-b97c-1f4090017838 req-8a3e855c-a992-4015-9d0a-5d9ea243c98f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:48.013279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4325045d-eab5-497c-b97c-1f4090017838 req-8a3e855c-a992-4015-9d0a-5d9ea243c98f service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:48.027298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-4325045d-eab5-497c-b97c-1f4090017838 req-8a3e855c-a992-4015-9d0a-5d9ea243c98f service nova] Creating event network-changed:85921f59-194d-4e06-a860-533aed7cda88 for instance 47789853-d310-42ed-81c5-3006cec1272f on hv-cinder-85236 Aug 09 12:33:48.032303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-4325045d-eab5-497c-b97c-1f4090017838 req-8a3e855c-a992-4015-9d0a-5d9ea243c98f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033749 Aug 09 12:33:48.032976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 523/1040] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:33:48.468898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:48.469991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:48.476437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:48.476924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:48.477386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:48.478084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:48.478566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:48.479000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:48.615328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:48.623661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ad8abfa9-d414-4ed7-b037-06300b8639c8 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.158879 Aug 09 12:33:48.624236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 518/1041] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:48 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:48.826204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:48.826877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:48.833928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:48.834414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:48.834855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:48.835581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:48.836035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:48.836495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:48.975255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:48.983397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-807010d5-c751-4f21-b4b6-3a8c488a5693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.161949 Aug 09 12:33:48.983971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 524/1042] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:48 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:49.645024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:49.645571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-aeacea91-569e-42f2-b29c-65ddddd806b5 req-e7e54f16-ea94-4d3a-a16c-3493d2d95fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e522aa4-f477-478c-9f4c-39e0c4202b36", "name": "network-vif-plugged", "status": "completed", "tag": "aaa1a38f-9266-45a9-a223-7009cbc288e0"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:49.645677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:49.653136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:49.653647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:49.654160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:49.654851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:49.655314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:49.655745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:49.656359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-aeacea91-569e-42f2-b29c-65ddddd806b5 req-e7e54f16-ea94-4d3a-a16c-3493d2d95fde service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:49.656887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-aeacea91-569e-42f2-b29c-65ddddd806b5 req-e7e54f16-ea94-4d3a-a16c-3493d2d95fde service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:49.657468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-aeacea91-569e-42f2-b29c-65ddddd806b5 req-e7e54f16-ea94-4d3a-a16c-3493d2d95fde service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:49.671077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-aeacea91-569e-42f2-b29c-65ddddd806b5 req-e7e54f16-ea94-4d3a-a16c-3493d2d95fde service nova] Creating event network-vif-plugged:aaa1a38f-9266-45a9-a223-7009cbc288e0 for instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 on hv-cinder-85236 Aug 09 12:33:49.675980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-aeacea91-569e-42f2-b29c-65ddddd806b5 req-e7e54f16-ea94-4d3a-a16c-3493d2d95fde service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034280 Aug 09 12:33:49.676796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 525/1043] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:49.788888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:49.796683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-057f3e8e-01de-4739-98a3-02388d8d74e4 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.155713 Aug 09 12:33:49.797260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 519/1044] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:49 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:49.900355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:49.902631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:49.909486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:49.909964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:49.910390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:49.911092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:49.911584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:49.912021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:49.940993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42fb88e1-bf7d-4672-ab30-c6a79a99fd07 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045002 Aug 09 12:33:49.941539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 526/1045] 10.222.0.60 () {60 vars in 1343 bytes} [Tue Aug 9 12:33:49 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:50.004867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:50.005219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:50.005471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:50.005716 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:50.011694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:50.011852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:50.012182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:50.012464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:50.012609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:50.012901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:50.013302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:50.013673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:50.013959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:50.014253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:50.014382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:50.014679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:50.040200 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:33:50.109334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:33:50.111536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:33:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 (ip 10.222.0.60) !!! Aug 09 12:33:50.125116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f12bca1b-b1c7-4583-9d2d-843c7bd01f0f tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 204 len: 0 microversion: 2.20 time: 0.124069 Aug 09 12:33:50.125794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 527/1046] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Aug 9 12:33:49 2022] DELETE /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 12:33:50.134382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:50.135071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:50.141482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:50.142365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:50.142859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:50.143561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:50.144014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:50.144463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:50.153344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:50.160849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-592bcde0-70ac-4d65-b79e-ce42c2eab928 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.160071 Aug 09 12:33:50.161556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 520/1047] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:49 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:50.539895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:50.551108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:50.552944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:50.554608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-095c27fb-4a4e-45f5-8baa-9c4ab0badefa tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.424094 Aug 09 12:33:50.555312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 528/1048] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:33:50 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:33:50.817582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:50.818262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:50.820479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:50.821129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=6 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:50.828087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:50.828638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:50.829088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:50.829832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:50.830323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:50.830814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:50.968146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:50.976991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cccbaa2a-27e1-413f-bcc1-98099dae9164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.163773 Aug 09 12:33:50.977694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 521/1049] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:50 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:51.183860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:51.184677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:51.192729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:51.193212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:51.193679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:51.194367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:51.194816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:51.195235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:51.330230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:51.337860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-341e21d9-cbe1-4342-97c8-5c88beacd16e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.159782 Aug 09 12:33:51.338433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 529/1050] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:51 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:51.585712 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:51.586713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:51.596887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:51.597682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:51.598389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:51.599530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:51.600285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:51.601033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:51.738614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:51.749020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:51.751412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:51.753373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7edff55c-e88a-4cc6-8788-a937207bc8cb tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.174286 Aug 09 12:33:51.754194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 522/1051] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:33:51 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:33:51.999450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:52.000047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:52.006649 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:52.007130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:52.007553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:52.008234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:52.008710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:52.009125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:52.314705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:52.322511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7083b933-a9aa-46da-b530-e3a16579dac3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.327296 Aug 09 12:33:52.323251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 530/1052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:51 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:52.359160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:52.359748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:52.366622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:52.367106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:52.367532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:52.368460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:52.368913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:52.369334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:52.497396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:52.505640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5f59bad7-503a-46c9-bd5c-91fefeec7249 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.150611 Aug 09 12:33:52.506186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 523/1053] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:52 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:52.786995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:52.787534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:52.793697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:52.794162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:52.794584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:52.795265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:52.795706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:52.796120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:52.931440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:52.939631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:52.941176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:52.942376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73cea983-eff0-47a6-9265-be67a0e33579 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.160050 Aug 09 12:33:52.942939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 531/1054] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:33:52 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:33:53.347622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:53.348293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:53.356773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:53.357421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:53.357997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:53.358918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:53.359552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:53.360294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:53.514676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:53.522773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-348ca9ac-bff7-450e-95d9-2bd891366b59 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.181318 Aug 09 12:33:53.523355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 524/1055] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:53 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:53.532567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:53.533153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:53.541322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:53.541992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:53.542534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:53.543338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:53.543889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:53.544570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:53.684568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:53.692432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-28603cdc-11fd-458f-b4af-f35adcb2302c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.163759 Aug 09 12:33:53.693005 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 532/1056] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:53 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:53.965681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:53.966293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:53.972700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:53.973193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:53.973632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:53.974334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:53.974794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:53.975215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.080408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:54.080990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:54.082849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:54.083571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=10 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:54.093116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.093606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.094048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.094757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.095211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.095668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.119280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lazy-loading 'flavor' on Instance uuid a368964e-2b12-4ec7-a757-4cf2796910ab {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:33:54.164173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:54.208913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eded1a2e-527e-40a0-b571-358ecc07d347 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "POST /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab/action" status: 202 len: 0 microversion: 2.1 time: 0.132356 Aug 09 12:33:54.209739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 533/1057] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:33:54 2022] POST /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:33:54.218404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:54.219098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:54.225467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.225952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.226409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.227083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.227510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.227929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.242144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:54.251346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:54.253339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:54.256732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4e5f391-c0ef-4878-a345-e147390136dd tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1721 microversion: 2.20 time: 0.295019 Aug 09 12:33:54.257378 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 525/1058] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:33:53 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:33:54.429172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:54.438546 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-483ba15d-3cd7-4d30-bf2e-20066f790e1f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.224129 Aug 09 12:33:54.452565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 534/1059] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:54 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:54.543568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:54.544164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:54.550620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.551107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.551539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.552236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.552721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.553142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.712986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:54.713560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:54.719952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.720463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.721075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.721818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.722274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.722699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.736202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:54.743931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-808658db-4ed8-4e14-8c79-9a9a5b024b58 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.204136 Aug 09 12:33:54.744777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 526/1060] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:54 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:54.965467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-3f390622-d0b8-4a75-b621-387d9766a29b req-67b0f6fd-c90e-4dae-af5d-0bc4a301e60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74", "name": "network-vif-deleted", "tag": "5ba0f75a-7788-4550-a660-9c0021b0abc0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:54.975123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:54.977725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-3f390622-d0b8-4a75-b621-387d9766a29b req-67b0f6fd-c90e-4dae-af5d-0bc4a301e60e service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:54.978280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-3f390622-d0b8-4a75-b621-387d9766a29b req-67b0f6fd-c90e-4dae-af5d-0bc4a301e60e service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:54.978776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-3f390622-d0b8-4a75-b621-387d9766a29b req-67b0f6fd-c90e-4dae-af5d-0bc4a301e60e service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:54.987723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-450eaf91-d028-4449-ab0d-da5428e7926f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1319 microversion: 2.1 time: 0.278458 Aug 09 12:33:54.988436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 535/1061] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:54 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:54.991171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-3f390622-d0b8-4a75-b621-387d9766a29b req-67b0f6fd-c90e-4dae-af5d-0bc4a301e60e service nova] Creating event network-vif-deleted:5ba0f75a-7788-4550-a660-9c0021b0abc0 for instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 on hv-cinder-85236 Aug 09 12:33:55.003332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-3f390622-d0b8-4a75-b621-387d9766a29b req-67b0f6fd-c90e-4dae-af5d-0bc4a301e60e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042006 Aug 09 12:33:55.003945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 527/1062] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:33:55.280758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:55.281477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:55.288225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:55.288822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:55.289313 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:55.290073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:55.290613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:55.291122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:55.324246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:55.324729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:55.325152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:55.325589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lazy-loading 'fault' on Instance uuid 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:33:55.368906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:55.378318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:55.379825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b6717f94a3844d1b82817e0f4adcebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ee39a09d0b4e67898ac55e4fc8aaee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:55.381012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cfabf350-c661-4019-8af6-edbc7bde18bc tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 200 len: 1371 microversion: 2.20 time: 0.104271 Aug 09 12:33:55.381574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 536/1063] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:33:55 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 12:33:55.462140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:55.462957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:55.470057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:55.470618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:55.471158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:55.471900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:55.472412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:55.472922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:55.642061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:55.651785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d9ee05d5-296a-4ea0-843c-e0700c015a73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.194308 Aug 09 12:33:55.652509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 528/1064] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:55 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:55.766233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:55.767762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:55.774998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:55.775476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:55.775902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:55.776639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:55.777249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:55.786090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-8fd665fc-c692-4352-89ff-eb20048f3bde req-964aba14-8ad4-45fd-8a8a-b63e83590c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47789853-d310-42ed-81c5-3006cec1272f", "name": "network-vif-plugged", "status": "completed", "tag": "85921f59-194d-4e06-a860-533aed7cda88"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:33:55.788051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:55.799141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-8fd665fc-c692-4352-89ff-eb20048f3bde req-964aba14-8ad4-45fd-8a8a-b63e83590c6d service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:55.800311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-8fd665fc-c692-4352-89ff-eb20048f3bde req-964aba14-8ad4-45fd-8a8a-b63e83590c6d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:55.805481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-8fd665fc-c692-4352-89ff-eb20048f3bde req-964aba14-8ad4-45fd-8a8a-b63e83590c6d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:55.818370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-8fd665fc-c692-4352-89ff-eb20048f3bde req-964aba14-8ad4-45fd-8a8a-b63e83590c6d service nova] Creating event network-vif-plugged:85921f59-194d-4e06-a860-533aed7cda88 for instance 47789853-d310-42ed-81c5-3006cec1272f on hv-cinder-85236 Aug 09 12:33:55.823911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-8fd665fc-c692-4352-89ff-eb20048f3bde req-964aba14-8ad4-45fd-8a8a-b63e83590c6d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042035 Aug 09 12:33:55.825313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 529/1065] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:33:55.959400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:55.968012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1aefe61-3acf-4b73-9425-296fc91c38ec tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.206877 Aug 09 12:33:55.969014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 537/1066] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:55 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:56.011395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:56.012091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:56.022460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:56.023296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:56.024029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:56.025291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:56.026646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:56.027097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:56.032703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:56.241936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:56.256036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6fcae56f-a7d5-4a5d-8a30-e831f03a87e4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1508 microversion: 2.1 time: 0.248144 Aug 09 12:33:56.257515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 530/1067] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:56 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:56.406232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:56.406933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:56.414091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:56.414489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:56.414948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:56.415646 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:56.416095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:56.416551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:56.432097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] HTTP exception thrown: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Request method failure captured: Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 HTTP/1.1 Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lH4IQ3ZwJ6PHnGmB-dNAvDoxr_2tS75Cz4Wi3L0Tj3VDcqLlrPVXqI8hnbMiOXyZJKdFu3EFWRiW36-4U6jRiECuJL4F-CO8sI3Urhj-B2RLq_DaqlWfrIZ4T8AG4X_ZMSuvyzfgeGBbBbeKTroPXhqOI56JRISTCd9VCzTHsC_h_I Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:33:56.433853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: b6717f94a3844d1b82817e0f4adcebad Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:56.435856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74'} Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:56.436814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:56.438400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:56.440682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Returning 404 to user: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:56.440682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7d873a7-55f9-4884-8327-5ab95c62e484 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 404 len: 111 microversion: 2.20 time: 0.034013 Aug 09 12:33:56.440682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 538/1068] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:33:56 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:33:56.446293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b73747e3-c65d-4156-9982-5a46c867ae8d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '.version_select at 0x7f0e080b9c10>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:56.470618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b73747e3-c65d-4156-9982-5a46c867ae8d tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-160735014" status: 204 len: 0 microversion: 2.20 time: 0.029617 Aug 09 12:33:56.471665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 531/1069] 10.222.0.60 () {60 vars in 1259 bytes} [Tue Aug 9 12:33:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-160735014 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 12:33:56.675865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:56.685368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:56.694134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:56.694633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:56.695162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:56.695762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:56.696215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:56.696710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:56.965962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:56.976345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f765d971-fc88-4739-9f99-68d7b16dabf3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.306015 Aug 09 12:33:56.977060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 539/1070] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:56 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:56.990420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:56.991903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:56.998848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:56.999298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:56.999952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:57.000635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:57.001292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:57.001712 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:57.209529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:57.217720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4b7d0afb-6839-4a13-80c7-97910188b86e tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.232055 Aug 09 12:33:57.218591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 532/1071] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:56 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:33:58.002576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:58.003194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:58.010474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:58.010963 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:58.011391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:58.012096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:58.012591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:58.013013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:58.150951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:58.158709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c734b5da-670d-4831-9911-70cb754ec2bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.161712 Aug 09 12:33:58.159271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 540/1072] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:57 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:58.240807 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:58.241556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:58.248953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:58.249430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:58.249882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:58.250555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:58.251005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:58.251424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:58.400839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:58.408518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8474f27e-ff64-4fc9-b1fe-7c62a095c5ac tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1313 microversion: 2.1 time: 0.172696 Aug 09 12:33:58.409110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 533/1073] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:58 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:58.501352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:58.501852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:58.510395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:58.510879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:58.511310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:58.512140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:58.512910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:58.513513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:58.530580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] HTTP exception thrown: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Request method failure captured: Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 HTTP/1.1 Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lH4IQ3ZwJ6PHnGmB-dNAvDoxr_2tS75Cz4Wi3L0Tj3VDcqLlrPVXqI8hnbMiOXyZJKdFu3EFWRiW36-4U6jRiECuJL4F-CO8sI3Urhj-B2RLq_DaqlWfrIZ4T8AG4X_ZMSuvyzfgeGBbBbeKTroPXhqOI56JRISTCd9VCzTHsC_h_I Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:33:58.532348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: b6717f94a3844d1b82817e0f4adcebad Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.539610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74'} Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:58.540721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.542851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.545889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Returning 404 to user: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:58.545889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7c1da7b7-7292-4c6d-b5fd-5282e33f8881 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 404 len: 111 microversion: 2.20 time: 0.037073 Aug 09 12:33:58.545889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 541/1074] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Aug 9 12:33:58 2022] DELETE /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 12:33:58.546422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:58.547681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:58.554683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:58.555175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:58.555600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:58.556306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:58.556786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:58.557208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:58.571656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] HTTP exception thrown: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Request method failure captured: Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 HTTP/1.1 Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lH4IQ3ZwJ6PHnGmB-dNAvDoxr_2tS75Cz4Wi3L0Tj3VDcqLlrPVXqI8hnbMiOXyZJKdFu3EFWRiW36-4U6jRiECuJL4F-CO8sI3Urhj-B2RLq_DaqlWfrIZ4T8AG4X_ZMSuvyzfgeGBbBbeKTroPXhqOI56JRISTCd9VCzTHsC_h_I Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:33:58.573404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: b6717f94a3844d1b82817e0f4adcebad Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.576591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74'} Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:58.578607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. Aug 09 12:33:58.582243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:58.584826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Returning 404 to user: Instance 8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:58.584826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8af050bb-0fd0-4848-a3e3-5f97ca2adb92 tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74" status: 404 len: 111 microversion: 2.20 time: 0.034160 Aug 09 12:33:58.584826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 534/1075] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:33:58 2022] GET /compute/v2.1/servers/8568180e-e3c7-4a1c-bf8f-bb7f8f59ce74 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:33:59.180612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:59.181292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:59.187600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:59.188108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:59.188563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:59.189244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:59.189694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:59.190134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:59.337798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:59.345883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42e5af00-fcbc-4f72-82d4-5de6e1c3c55f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.169422 Aug 09 12:33:59.346444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 542/1076] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:59 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:59.432826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:59.433432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:59.442828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:59.443308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:59.443729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:59.444478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:59.444934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:59.445354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:59.579256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:33:59.586907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0be5f2a9-ca47-4aa1-9000-114c42e0f512 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1497 microversion: 2.1 time: 0.160521 Aug 09 12:33:59.587494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 535/1077] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:33:59 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:33:59.731872 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:59.732683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:59.740699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:59.741169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:59.741594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:59.742277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:59.742721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:59.743129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:59.757555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] HTTP exception thrown: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Request method failure captured: Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 HTTP/1.1 Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lH4IQ3ZwJ6PHnGmB-dNAvDoxr_2tS75Cz4Wi3L0Tj3VDcqLlrPVXqI8hnbMiOXyZJKdFu3EFWRiW36-4U6jRiECuJL4F-CO8sI3Urhj-B2RLq_DaqlWfrIZ4T8AG4X_ZMSuvyzfgeGBbBbeKTroPXhqOI56JRISTCd9VCzTHsC_h_I Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:33:59.759120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: b6717f94a3844d1b82817e0f4adcebad Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.760885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '1af3fcd4-07fc-4de6-8634-f028e6c4f369'} Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:59.761712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.763002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.764297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Returning 404 to user: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:59.764297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0930ec75-51cf-44ad-a393-2bf100a4f45e tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "DELETE /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 404 len: 111 microversion: 2.20 time: 0.034227 Aug 09 12:33:59.764297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 543/1078] 10.222.0.60 () {60 vars in 1280 bytes} [Tue Aug 9 12:33:59 2022] DELETE /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:33:59.769831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:33:59.770823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] [instance: 1af3fcd4-07fc-4de6-8634-f028e6c4f369] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:33:59.776964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:59.777485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:59.777925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:59.778662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:33:59.779099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:33:59.779517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:33:59.793489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] HTTP exception thrown: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Request method failure captured: Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 HTTP/1.1 Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lH4IQ3ZwJ6PHnGmB-dNAvDoxr_2tS75Cz4Wi3L0Tj3VDcqLlrPVXqI8hnbMiOXyZJKdFu3EFWRiW36-4U6jRiECuJL4F-CO8sI3Urhj-B2RLq_DaqlWfrIZ4T8AG4X_ZMSuvyzfgeGBbBbeKTroPXhqOI56JRISTCd9VCzTHsC_h_I Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:33:59.795074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/12ee39a09d0b4e67898ac55e4fc8aaee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 12ee39a09d0b4e67898ac55e4fc8aaee Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1558603135 Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: b6717f94a3844d1b82817e0f4adcebad Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1558603135-project Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.796850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '1af3fcd4-07fc-4de6-8634-f028e6c4f369'} Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:33:59.797779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. Aug 09 12:33:59.799260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:33:59.800714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] Returning 404 to user: Instance 1af3fcd4-07fc-4de6-8634-f028e6c4f369 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:33:59.800714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a879f024-c540-45db-ad96-e756808dc80b tempest-AttachVolumeShelveTestJSON-1558603135 tempest-AttachVolumeShelveTestJSON-1558603135-project] 10.222.0.60 "GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369" status: 404 len: 111 microversion: 2.20 time: 0.030807 Aug 09 12:33:59.800714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 536/1079] 10.222.0.60 () {60 vars in 1277 bytes} [Tue Aug 9 12:33:59 2022] GET /compute/v2.1/servers/1af3fcd4-07fc-4de6-8634-f028e6c4f369 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:34:00.225922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:00.226479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:00.233277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:00.233758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:00.234183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:00.234866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:00.235314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:00.235729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:00.265530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:34:00.358101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64e4b09c-217c-40b8-919f-1cc031054ad5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "DELETE /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 204 len: 0 microversion: 2.1 time: 0.135721 Aug 09 12:34:00.359069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 544/1080] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:34:00 2022] DELETE /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:34:00.367726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:00.368908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:00.375296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:00.376112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:00.376472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:00.376964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:00.377372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:00.378261 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:00.378903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:00.379290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:00.385458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:00.385992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:00.386489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:00.387228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:00.387842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:00.388367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:00.678695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:00.686611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6b04099-637e-4e45-bf06-b04d56eb3c6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.323284 Aug 09 12:34:00.687323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:00.687555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 537/1081] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:00 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:00.705192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4547d797-943c-42a2-ab89-0e22716bf336 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1503 microversion: 2.1 time: 0.339191 Aug 09 12:34:00.705732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 545/1082] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:00 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:01.708984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:01.709607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:01.718270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:01.718270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:01.718270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:01.724350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:01.724963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:01.725413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:01.727800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:01.728987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:01.739092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:01.739865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:01.740515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:01.741403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:01.742022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:01.742607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:01.966103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:01.967688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:01.981256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d00a0cba-a413-4b97-986c-b64bee0077bb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.276100 Aug 09 12:34:01.981878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-055c1b93-a8df-4453-9e25-a90df1243706 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1503 microversion: 2.1 time: 0.257965 Aug 09 12:34:01.996264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 546/1083] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:01 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:01.996628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 538/1084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:01 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:02.943587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-46a7ec26-67f1-436f-bef6-1c2a26fe1644 req-563bfa30-cebe-48ed-9ab0-d4dba53e8969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47789853-d310-42ed-81c5-3006cec1272f", "name": "network-vif-deleted", "tag": "85921f59-194d-4e06-a860-533aed7cda88"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:02.954329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-46a7ec26-67f1-436f-bef6-1c2a26fe1644 req-563bfa30-cebe-48ed-9ab0-d4dba53e8969 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:02.954899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-46a7ec26-67f1-436f-bef6-1c2a26fe1644 req-563bfa30-cebe-48ed-9ab0-d4dba53e8969 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:02.955418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-46a7ec26-67f1-436f-bef6-1c2a26fe1644 req-563bfa30-cebe-48ed-9ab0-d4dba53e8969 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:02.970888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-46a7ec26-67f1-436f-bef6-1c2a26fe1644 req-563bfa30-cebe-48ed-9ab0-d4dba53e8969 service nova] Creating event network-vif-deleted:85921f59-194d-4e06-a860-533aed7cda88 for instance 47789853-d310-42ed-81c5-3006cec1272f on hv-cinder-85236 Aug 09 12:34:02.977310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-46a7ec26-67f1-436f-bef6-1c2a26fe1644 req-563bfa30-cebe-48ed-9ab0-d4dba53e8969 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040394 Aug 09 12:34:02.978118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 547/1085] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:03.004834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:03.007014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:03.009134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:03.010326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:03.017306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:03.018053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:03.018724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:03.019626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:03.020326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:03.021019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:03.021510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:03.022145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:03.022585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:03.023384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:03.029236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:03.029795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:03.158235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:03.169510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e4cedeb6-b2ec-4a8e-9633-bfa660d186d5 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 200 len: 1298 microversion: 2.1 time: 0.170002 Aug 09 12:34:03.184419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 539/1086] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:02 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 1298 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:03.268919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:03.278595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eb2c1c96-137f-43e4-b09a-95ba3e94f6c0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.279027 Aug 09 12:34:03.279422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 548/1087] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:02 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:04.213637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:04.214252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: 47789853-d310-42ed-81c5-3006cec1272f] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:04.227661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:04.228152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:04.228647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:04.229323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:04.229827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:04.230219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:04.256042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] HTTP exception thrown: Instance 47789853-d310-42ed-81c5-3006cec1272f could not be found. Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Request method failure captured: Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f HTTP/1.1 Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lQl_yZKwBBWx5k7WLFl8eAaVayhIJJemUs3H7DIo41LFAh2KB6lQDSe2OFkw_jJjdpnxQvQeHKIJ3YjHdQgy4lWBoyIZY9qshu_tnTRw3bgagceZK-cXYxPeFf4Rj4or8WpvjwSAX3cSKz634bI6qaMJrZcTIdI6kf9MczDkz99NaE Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: f461ddd7986842159c8e8177a7825435 Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesActionsTest-1324976255 Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:34:04.257732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f461ddd7986842159c8e8177a7825435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f461ddd7986842159c8e8177a7825435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f461ddd7986842159c8e8177a7825435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f461ddd7986842159c8e8177a7825435"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesActionsTest-1324976255 Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: f461ddd7986842159c8e8177a7825435 Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesActionsTest-1324976255 Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesActionsTest-1324976255-project Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: e9f9a02ea89f4991a3042c14cf869432 Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesActionsTest-1324976255-project Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 47789853-d310-42ed-81c5-3006cec1272f could not be found. Aug 09 12:34:04.259317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '47789853-d310-42ed-81c5-3006cec1272f'} Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47789853-d310-42ed-81c5-3006cec1272f could not be found. Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:34:04.260182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47789853-d310-42ed-81c5-3006cec1272f could not be found. Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47789853-d310-42ed-81c5-3006cec1272f could not be found. Aug 09 12:34:04.261649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:04.264524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Returning 404 to user: Instance 47789853-d310-42ed-81c5-3006cec1272f could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:34:04.265596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ddafcc82-1fdd-47dd-8a9c-ae89b20ef242 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f" status: 404 len: 111 microversion: 2.1 time: 0.059573 Aug 09 12:34:04.268370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 540/1088] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:04 2022] GET /compute/v2.1/servers/47789853-d310-42ed-81c5-3006cec1272f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:34:04.312610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:04.313334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:04.316979 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:04.322695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:04.323190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:04.323750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:04.324449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:04.324896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:04.325485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:04.406357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-547590088", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "networks": [{"uuid": "92679a07-cfb0-4c70-bb12-48874d80f9ac"}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:04.473019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:04.480620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] validate_networks() for [('92679a07-cfb0-4c70-bb12-48874d80f9ac', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:34:04.482667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8270bc4d-54a1-4033-af55-e989b47f2b21 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.180892 Aug 09 12:34:04.483757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 549/1089] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:04 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:34:04.871845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:34:04.872362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:34:04.872948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:34:04.873424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:34:04.873903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:34:04.883015 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:04.883845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:04.884598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:04.885559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:04.886452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:04.887112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:04.906150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Getting quotas for project f461ddd7986842159c8e8177a7825435. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:34:04.910573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Getting quotas for user e9f9a02ea89f4991a3042c14cf869432 and project f461ddd7986842159c8e8177a7825435. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:34:04.921489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:34:04.924008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:34:04.979079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a631d6bb-2463-407a-9db8-ad5cd89e6d14 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583160 Aug 09 12:34:04.980483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 541/1090] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:34:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 12:34:04.992523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d4c46ef6-7cf0-4971-841d-5e48631ce03d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:05.005178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d4c46ef6-7cf0-4971-841d-5e48631ce03d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:05.064527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f500159-d7bb-47dc-9bf2-4b68925fbae0 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Action: 'create', calling method: .version_select at 0x7f0e082cfc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2006706996", "metadata": {"Type": "work"}}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:05.075164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d4c46ef6-7cf0-4971-841d-5e48631ce03d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:05.082386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d4c46ef6-7cf0-4971-841d-5e48631ce03d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1213 microversion: 2.1 time: 0.095545 Aug 09 12:34:05.084622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 542/1091] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:04 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:34:05.436943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f500159-d7bb-47dc-9bf2-4b68925fbae0 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.505450 Aug 09 12:34:05.438001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 550/1092] 10.222.0.60 () {60 vars in 1156 bytes} [Tue Aug 9 12:34:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 507 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 09 12:34:05.451449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9f79ddb7-f73c-4155-ac40-6c4af1010ecd tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Calling method '.version_select at 0x7f0e0842d940>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:05.508762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:05.509381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:05.518747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:05.519275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:05.519710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:05.521022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:05.521546 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:05.522348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:05.527849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:05.533160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9f79ddb7-f73c-4155-ac40-6c4af1010ecd tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410" status: 200 len: 353 microversion: 2.1 time: 0.086497 Aug 09 12:34:05.533744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 543/1093] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:34:05 2022] GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:05.733377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:05.742138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-00b1c16c-5cbd-494e-b3c7-d273bea18965 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.238919 Aug 09 12:34:05.742722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 551/1094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:05 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:06.105455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:06.106095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:06.113413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:06.113902 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:06.114368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:06.115059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:06.115513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:06.115937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:06.189553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:06.197297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a7147f07-d7dc-497d-84b4-8ef6f62d47fc tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1273 microversion: 2.1 time: 0.095816 Aug 09 12:34:06.197863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 544/1095] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:06 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:06.546960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1862aba0-ea9b-4416-9e94-49c571fd84c6 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Calling method '.version_select at 0x7f0e0817fca0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:06.606652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1862aba0-ea9b-4416-9e94-49c571fd84c6 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410" status: 200 len: 354 microversion: 2.1 time: 0.063588 Aug 09 12:34:06.607398 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 552/1096] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:34:06 2022] GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410 => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:06.622074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c770fa23-cde3-43d8-a1ec-4a8715b7a023 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Calling method '.version_select at 0x7f0e0842d430>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:06.674101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c770fa23-cde3-43d8-a1ec-4a8715b7a023 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410" status: 200 len: 354 microversion: 2.1 time: 0.056222 Aug 09 12:34:06.674664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 545/1097] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:34:06 2022] GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:06.697976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1e4897c-45c8-4bc1-babb-69256cbc86f2 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Calling method '.version_select at 0x7f0e082cf9d0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:06.763931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:06.764587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:06.767834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:06.772901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1e4897c-45c8-4bc1-babb-69256cbc86f2 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410" status: 202 len: 0 microversion: 2.1 time: 0.079040 Aug 09 12:34:06.774308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:06.774440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 553/1098] 10.222.0.60 () {58 vars in 1248 bytes} [Tue Aug 9 12:34:06 2022] DELETE /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:34:06.774809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:06.775503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:06.776197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:06.776743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:06.777204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:06.783662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c348b7e6-6442-4ab5-9958-89105fba218f tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Calling method '.version_select at 0x7f0e0826e3a0>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:06.836746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c348b7e6-6442-4ab5-9958-89105fba218f tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410" status: 200 len: 353 microversion: 2.1 time: 0.057865 Aug 09 12:34:06.837329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 554/1099] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:34:06 2022] GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:06.922765 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:06.930810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7e19ab3e-a599-430b-b003-858802f15159 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.170816 Aug 09 12:34:06.931397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 546/1100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:06 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:34:07.219042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:07.219770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:07.226026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:07.226505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:07.226938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:07.227615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:07.228071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:07.228486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:07.290855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:07.299509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa026714-af72-4675-8b9f-32d6cdfbbea3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1273 microversion: 2.1 time: 0.084506 Aug 09 12:34:07.300105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 555/1101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:07 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:07.852341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c05f6b7-348e-4069-84d0-450019564ac7 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Calling method '.version_select at 0x7f0e0842db80>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:07.885060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-0c05f6b7-348e-4069-84d0-450019564ac7 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] HTTP exception thrown: Volume 1f504aef-20ea-4289-9ea8-19111425a410 could not be found. Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c05f6b7-348e-4069-84d0-450019564ac7 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Request method failure captured: Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410 HTTP/1.1 Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lQ8yCzAxAnxW3NJyNgZhBoxoM0LOXWEPwdx9ZQ6xAOmetrYfMNXmiC97NFMAvv-tSVLDl9wdM0tE7ndHII0OIw6AMYwYHwQrrNy5J304A9m1GB8MNXOtsJQ8qjEK0zswWjZqPBx-7XKJpCC0oNkLs0MQ5pru-Dpph1Vnu5bxTIFdho Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: d55cfcb5accd450b8ababe8eb6a1a4f9 Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesGetTestJSON-1184593137 Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:34:07.888237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d55cfcb5accd450b8ababe8eb6a1a4f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/d55cfcb5accd450b8ababe8eb6a1a4f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_d55cfcb5accd450b8ababe8eb6a1a4f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/d55cfcb5accd450b8ababe8eb6a1a4f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesGetTestJSON-1184593137 Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: d55cfcb5accd450b8ababe8eb6a1a4f9 Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesGetTestJSON-1184593137 Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesGetTestJSON-1184593137-project Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 2fb8be563bd540de9346b7295090ea1b Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesGetTestJSON-1184593137-project Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Volume 1f504aef-20ea-4289-9ea8-19111425a410 could not be found. Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '1f504aef-20ea-4289-9ea8-19111425a410'} Aug 09 12:34:07.889915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f504aef-20ea-4289-9ea8-19111425a410 could not be found. (HTTP 404) (Request-ID: req-0d7d8b03-992d-4de3-9ae4-75d5c490d66a) Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:34:07.890866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 12:34:07.893005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f504aef-20ea-4289-9ea8-19111425a410 could not be found. Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 12:34:07.894474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f504aef-20ea-4289-9ea8-19111425a410 could not be found. Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f504aef-20ea-4289-9ea8-19111425a410 could not be found. Aug 09 12:34:07.895914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:07.899151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c05f6b7-348e-4069-84d0-450019564ac7 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] Returning 404 to user: Volume 1f504aef-20ea-4289-9ea8-19111425a410 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:34:07.900037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c05f6b7-348e-4069-84d0-450019564ac7 tempest-VolumesGetTestJSON-1184593137 tempest-VolumesGetTestJSON-1184593137-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410" status: 404 len: 109 microversion: 2.1 time: 0.052899 Aug 09 12:34:07.905640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 547/1102] 10.222.0.60 () {58 vars in 1245 bytes} [Tue Aug 9 12:34:07 2022] GET /compute/v2.1/os-volumes/1f504aef-20ea-4289-9ea8-19111425a410 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:34:07.957025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:07.957733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:07.964948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:07.965436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:07.966077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:07.966825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:07.967384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:07.967837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:08.167353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:08.176234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa06fcbd-6578-4577-87a4-f5e50ddb8dc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.224357 Aug 09 12:34:08.177708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 556/1103] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:07 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:08.323735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:08.324939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:08.333629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:08.334594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:08.335237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:08.336098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:08.336580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:08.337003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:08.537842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:08.545687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-800b7d6c-9cd2-4cf8-b9ce-fb4eeb0fcbba tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.228018 Aug 09 12:34:08.546605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 548/1104] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:08 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:09.063247 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-f9a8af50-049b-4f9f-9632-44b3609a733c req-df8b34ba-a7af-470c-a864-8f26f07c0dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af465084-381b-4ab6-b67f-92458e0ed98c", "tag": "2e67dea0-1b03-4d8c-a1f5-ad80c703482a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:09.075247 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f9a8af50-049b-4f9f-9632-44b3609a733c req-df8b34ba-a7af-470c-a864-8f26f07c0dca service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.076012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f9a8af50-049b-4f9f-9632-44b3609a733c req-df8b34ba-a7af-470c-a864-8f26f07c0dca service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.077185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-f9a8af50-049b-4f9f-9632-44b3609a733c req-df8b34ba-a7af-470c-a864-8f26f07c0dca service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.096006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-f9a8af50-049b-4f9f-9632-44b3609a733c req-df8b34ba-a7af-470c-a864-8f26f07c0dca service nova] Creating event network-changed:2e67dea0-1b03-4d8c-a1f5-ad80c703482a for instance af465084-381b-4ab6-b67f-92458e0ed98c on hv-cinder-85236 Aug 09 12:34:09.101610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-f9a8af50-049b-4f9f-9632-44b3609a733c req-df8b34ba-a7af-470c-a864-8f26f07c0dca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042208 Aug 09 12:34:09.102245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 557/1105] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:09.198100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:09.198717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:09.204866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.205559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.205797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.206535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.206992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.207439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.390915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:09.399483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7031d30b-e4fb-4aae-ab5f-b06e5896bab0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1568 microversion: 2.1 time: 0.205589 Aug 09 12:34:09.400725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 549/1106] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:09.422276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:09.422943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:09.429466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.429951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.430380 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.431072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.431804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.432412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.567573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:09.568411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:09.575224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.575813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.576503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.577421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.578409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.579652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.619208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117660) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 12:34:09.711354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a565d2f3-35b6-4e24-bb64-d5e9befe7cef tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "POST /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab/action" status: 202 len: 0 microversion: 2.1 time: 0.293365 Aug 09 12:34:09.712968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 558/1107] 10.222.0.60 () {60 vars in 1278 bytes} [Tue Aug 9 12:34:09 2022] POST /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:34:09.721720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:09.723241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:09.731499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.732477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.733563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.734423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:09.734889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:09.735313 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:09.879659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:09.887458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-110aed99-e167-4a6f-a0b1-31b4fecc85a7 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.324322 Aug 09 12:34:09.888025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 550/1108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:09 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:10.288535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:10.300502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2adc3952-9630-4f03-bb30-3ce097b48a60 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1516 microversion: 2.1 time: 0.582799 Aug 09 12:34:10.313303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 559/1109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1516 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:34:10.908879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:10.909476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:10.916293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:10.916825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:10.917262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:10.917948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:10.918589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:10.919015 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:11.055253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:11.063206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d7da2166-f799-4183-a3df-8fdba1cba17d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.158505 Aug 09 12:34:11.063781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 551/1110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:10 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:11.324819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:11.325440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:11.332571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:11.333063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:11.333524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:11.334534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:11.334995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:11.335421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:11.464145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:11.471831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5fccaa74-0bce-4517-a8a5-7c344803386f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1518 microversion: 2.1 time: 0.151109 Aug 09 12:34:11.472403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 560/1111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:11 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:11.659837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-e36a3eee-46d6-4d4c-8f5a-0b3ae8e7eef2 req-e85f8770-8db7-4342-83d4-8ee7613084f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a368964e-2b12-4ec7-a757-4cf2796910ab", "name": "network-vif-unplugged", "status": "completed", "tag": "547a0884-98cf-4ddd-b43b-9c8ffe94c31a"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:11.669877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-e36a3eee-46d6-4d4c-8f5a-0b3ae8e7eef2 req-e85f8770-8db7-4342-83d4-8ee7613084f2 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:11.670328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-e36a3eee-46d6-4d4c-8f5a-0b3ae8e7eef2 req-e85f8770-8db7-4342-83d4-8ee7613084f2 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:11.670758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-e36a3eee-46d6-4d4c-8f5a-0b3ae8e7eef2 req-e85f8770-8db7-4342-83d4-8ee7613084f2 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:11.693972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.compute.server_external_events [req-e36a3eee-46d6-4d4c-8f5a-0b3ae8e7eef2 req-e85f8770-8db7-4342-83d4-8ee7613084f2 service nova] Unable to find a host for instance a368964e-2b12-4ec7-a757-4cf2796910ab. Dropping event network-vif-unplugged {{(pid=117661) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 12:34:11.694412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-e36a3eee-46d6-4d4c-8f5a-0b3ae8e7eef2 req-e85f8770-8db7-4342-83d4-8ee7613084f2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038554 Aug 09 12:34:11.695630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 552/1112] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 12:34:12.084155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:12.084831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:12.091107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:12.091570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:12.092110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:12.092889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:12.093471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:12.093912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:12.239936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:12.247925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1624f8aa-9d97-4c38-b3d9-c7f10b73e76a tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.167819 Aug 09 12:34:12.248626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 561/1113] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:12 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:12.499385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:12.500435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:12.511397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:12.512198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:12.512977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:12.514126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:12.514876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:12.515582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:12.654071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:12.661736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e62873c1-2978-4e3d-80cf-60bcb3dd2f87 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1518 microversion: 2.1 time: 0.169397 Aug 09 12:34:12.662303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 553/1114] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:12 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:34:13.269457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:13.270124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:13.277133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:13.277672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:13.278123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:13.278872 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:13.279409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:13.279861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:13.417308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:13.424711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-716fe663-1689-4477-a4ae-c01ad349ce3b tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.159295 Aug 09 12:34:13.425277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 562/1115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:13 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:13.683324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:13.683922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:13.691552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:13.691552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:13.691775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:13.692420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:13.692870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:13.693289 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:13.846658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:13.854613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f7789612-2ffa-4b81-995e-07abd8285cd0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1518 microversion: 2.1 time: 0.175232 Aug 09 12:34:13.855196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 554/1116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:13 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:14.445809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:14.446694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:14.453717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:14.454204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:14.454723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:14.455448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:14.455908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:14.456340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:14.602056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:14.608516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-95975a39-5992-4445-b6b5-b22ceea95c21 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.166611 Aug 09 12:34:14.609103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 563/1117] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:14 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:14.880057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:14.880057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:14.888491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:14.889242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:14.889855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:14.890560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:14.891012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:14.891465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:14.903385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:14.904370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:15.054208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:15.061845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dc97c8fe-5594-4630-aa9a-c9a01602bcd9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1518 microversion: 2.1 time: 0.189434 Aug 09 12:34:15.062420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 555/1118] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:14 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:15.632610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:15.633895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:15.649190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:15.650051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:15.650487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:15.651360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:15.651821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:15.652245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:15.903731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:15.913050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb5f1db9-d56c-47cc-9413-585a3f71515f tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.286249 Aug 09 12:34:15.914566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 564/1119] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:15 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:16.087180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:16.089571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:16.092158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=8 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:16.098423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:16.099574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:16.100017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:16.100828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:16.102025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:16.102756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:16.273596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:16.280297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-97c3878b-4297-446b-834c-63544cedfa63 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.200209 Aug 09 12:34:16.281145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 556/1120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:16 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:34:16.934547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:16.935143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:16.942000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:16.942494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:16.942992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:16.943971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:16.945516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:16.946023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:17.108337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:17.117183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb7672a3-0ebb-4681-a84b-2ef0a3932416 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.186062 Aug 09 12:34:17.117755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 565/1121] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:16 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:17.301144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:17.301752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:17.308763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:17.309253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:17.309650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:17.310566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:17.311003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:17.311463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:17.455293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:17.463589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-30226129-d9cc-4bd6-9c35-a97917bbd1f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.166481 Aug 09 12:34:17.464166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 557/1122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:17 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:18.138312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:18.139030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:18.145344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:18.145896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:18.146397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:18.147187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:18.147626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:18.148139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:18.282685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:18.291630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c18e8ef0-2933-41e5-87c0-c6c9b89a4523 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.157173 Aug 09 12:34:18.303528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 566/1123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:18 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:18.485199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:18.485817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:18.493832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:18.495338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:18.496186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:18.496937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:18.497699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:18.498129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:18.502447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-2552c860-357e-4fa1-8eec-aeb015b3e070 req-c5033ee4-df69-46a0-94a7-d27e8e30c0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af465084-381b-4ab6-b67f-92458e0ed98c", "name": "network-vif-plugged", "status": "completed", "tag": "2e67dea0-1b03-4d8c-a1f5-ad80c703482a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:18.514105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2552c860-357e-4fa1-8eec-aeb015b3e070 req-c5033ee4-df69-46a0-94a7-d27e8e30c0a3 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:18.514664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2552c860-357e-4fa1-8eec-aeb015b3e070 req-c5033ee4-df69-46a0-94a7-d27e8e30c0a3 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:18.515228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-2552c860-357e-4fa1-8eec-aeb015b3e070 req-c5033ee4-df69-46a0-94a7-d27e8e30c0a3 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:18.528061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-2552c860-357e-4fa1-8eec-aeb015b3e070 req-c5033ee4-df69-46a0-94a7-d27e8e30c0a3 service nova] Creating event network-vif-plugged:2e67dea0-1b03-4d8c-a1f5-ad80c703482a for instance af465084-381b-4ab6-b67f-92458e0ed98c on hv-cinder-85236 Aug 09 12:34:18.536052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-2552c860-357e-4fa1-8eec-aeb015b3e070 req-c5033ee4-df69-46a0-94a7-d27e8e30c0a3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043948 Aug 09 12:34:18.538270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 567/1124] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:34:18.664066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:18.672994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-da0ff9ae-44b4-43aa-8040-86b8210cdd34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.191584 Aug 09 12:34:18.673568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 558/1125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:18 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:19.313801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:19.314388 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:19.321272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:19.321804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:19.322223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:19.322905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:19.323353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:19.323771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:19.457886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:19.466019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acb590a5-4c84-4007-aa5d-32f9423d3f49 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.157053 Aug 09 12:34:19.466603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 568/1126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:19 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:19.693898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:19.694676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:19.701223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:19.701706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:19.702137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:19.702832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:19.703278 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:19.703700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:19.875235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:19.885264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-34212e69-9b89-4697-a081-ccbc5a179c91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.195229 Aug 09 12:34:19.885854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 559/1127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:19 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:20.486893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:20.487504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:20.494778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:20.495242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:20.495675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:20.496753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:20.497327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:20.497680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:20.645828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:20.653531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c79b6898-295f-4b84-88ce-0175155e261d tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1313 microversion: 2.1 time: 0.170633 Aug 09 12:34:20.654084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 569/1128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:20 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:20.908829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:20.909710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:20.917109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:20.917589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:20.918009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:20.918696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:20.919142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:20.919553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:21.064077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:21.072903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a3179d6e-3e81-4b5c-9304-ab79fec39ba2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.168810 Aug 09 12:34:21.073583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 560/1129] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:20 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:21.251147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1bc9bae-99a4-48c2-9480-3b9e957e9ba8", "device": "/dev/sdb"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:21.254108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:21.260454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:21.260959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:21.261411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:21.262100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:21.262583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:21.262995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:21.419522 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:21.550314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44c42843-0f53-408e-8593-398509ff34fc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "POST /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302830 Aug 09 12:34:21.556761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 570/1130] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:34:21 2022] POST /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:21.674195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:21.674825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:21.681135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:21.681630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:21.682066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:21.682762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:21.683214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:21.683638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:21.820787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:21.828362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-322e3d43-ecf3-43ee-bf2f-fe25ae2ffa92 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1497 microversion: 2.1 time: 0.158148 Aug 09 12:34:21.828975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 561/1131] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:21 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:22.095870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:22.097174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:22.104215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:22.104757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:22.105318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:22.106030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:22.106482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:22.107443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:22.260623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:22.268138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f2ca18b-f4b3-490c-84c1-1192590dc080 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.177064 Aug 09 12:34:22.268734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 571/1132] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:22 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:22.515416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:22.515957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:22.522785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:22.523824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:22.524292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:22.525044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:22.525520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:22.525941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:22.552126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:34:22.640746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2df15aa1-5b3e-4620-867f-435094839c39 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "DELETE /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 204 len: 0 microversion: 2.1 time: 0.128718 Aug 09 12:34:22.641876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 562/1133] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:34:22 2022] DELETE /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:34:22.651413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:22.652106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:22.658869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:22.659528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:22.660248 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:22.661131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:22.661598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:22.661997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:22.816060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:22.824963 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1af45796-d72d-4b7d-b98d-a3958d5b3164 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1503 microversion: 2.1 time: 0.178464 Aug 09 12:34:22.825546 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 572/1134] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:22 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:23.296941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:23.297625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:23.304414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:23.305067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:23.305622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:23.306342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:23.306800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:23.307227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:23.441380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:23.449261 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ca451a5e-e854-4036-aa93-072022db5e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.156976 Aug 09 12:34:23.449825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 563/1135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:23 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:23.846388 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:23.846997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:23.853832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:23.854611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:23.855039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:23.855728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:23.856152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:23.856791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:23.989666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:23.999114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15d26ce8-919a-4702-ac4d-3d308dad9e53 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1503 microversion: 2.1 time: 0.156591 Aug 09 12:34:23.999820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 573/1136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:23 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:24.470486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:24.471099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:24.479108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:24.479613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:24.480051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:24.480793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:24.481254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:24.481697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:24.618970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:24.627095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ed8047d9-0a9b-405e-80a8-00bdc6cb0261 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.160715 Aug 09 12:34:24.627664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 564/1137] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:24 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:25.021023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:25.021588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:25.028412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:25.028893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:25.029339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:25.030020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:25.030445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:25.030875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:25.167085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:25.174512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-878356e8-b34b-4f65-bac6-097ea4934fa3 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1503 microversion: 2.1 time: 0.157499 Aug 09 12:34:25.175082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 574/1138] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:25 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:25.647361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:25.649250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:25.656748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:25.657223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:25.657658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:25.658358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:25.658804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:25.659405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:25.873593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:25.901954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fcbcb81a-4061-49b6-bb9c-a08e6de839dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.258478 Aug 09 12:34:25.902556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 565/1139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:25 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:26.089136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-55c90f65-8a49-4c69-af79-5c0ce032f6b5 req-c4acd13e-9717-4e37-9b63-e5f1ad4a6c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af465084-381b-4ab6-b67f-92458e0ed98c", "name": "network-vif-deleted", "tag": "2e67dea0-1b03-4d8c-a1f5-ad80c703482a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:26.099890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-55c90f65-8a49-4c69-af79-5c0ce032f6b5 req-c4acd13e-9717-4e37-9b63-e5f1ad4a6c64 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:26.100663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-55c90f65-8a49-4c69-af79-5c0ce032f6b5 req-c4acd13e-9717-4e37-9b63-e5f1ad4a6c64 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:26.101101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-55c90f65-8a49-4c69-af79-5c0ce032f6b5 req-c4acd13e-9717-4e37-9b63-e5f1ad4a6c64 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:26.113565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-55c90f65-8a49-4c69-af79-5c0ce032f6b5 req-c4acd13e-9717-4e37-9b63-e5f1ad4a6c64 service nova] Creating event network-vif-deleted:2e67dea0-1b03-4d8c-a1f5-ad80c703482a for instance af465084-381b-4ab6-b67f-92458e0ed98c on hv-cinder-85236 Aug 09 12:34:26.118696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-55c90f65-8a49-4c69-af79-5c0ce032f6b5 req-c4acd13e-9717-4e37-9b63-e5f1ad4a6c64 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033655 Aug 09 12:34:26.119319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 575/1140] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:26.195600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:26.196181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:26.202723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:26.203296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:26.203715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:26.204653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:26.205102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:26.205501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:26.238335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:26.238810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:26.239234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:26.239671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lazy-loading 'fault' on Instance uuid af465084-381b-4ab6-b67f-92458e0ed98c {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:34:26.282084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f9a02ea89f4991a3042c14cf869432', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f461ddd7986842159c8e8177a7825435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:26.289720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ad76aff-ae4f-4816-95aa-05e21138c368 tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 200 len: 1303 microversion: 2.1 time: 0.098212 Aug 09 12:34:26.290280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 566/1141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:26 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:26.923918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:26.925769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:26.932895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:26.933377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:26.933820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:26.934530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:26.935114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:26.935636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:27.083713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:27.091677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6e40380f-24fe-4efc-93a0-e483359af18b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.171929 Aug 09 12:34:27.107432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 576/1142] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:26 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:27.315091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:27.316019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] [instance: af465084-381b-4ab6-b67f-92458e0ed98c] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:27.324654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:27.325141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:27.325579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:27.326300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:27.326753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:27.327176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:27.342012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] HTTP exception thrown: Instance af465084-381b-4ab6-b67f-92458e0ed98c could not be found. Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Request method failure captured: Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c HTTP/1.1 Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lQl_yZKwBBWx5k7WLFl8eAaVayhIJJemUs3H7DIo41LFAh2KB6lQDSe2OFkw_jJjdpnxQvQeHKIJ3YjHdQgy4lWBoyIZY9qshu_tnTRw3bgagceZK-cXYxPeFf4Rj4or8WpvjwSAX3cSKz634bI6qaMJrZcTIdI6kf9MczDkz99NaE Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: f461ddd7986842159c8e8177a7825435 Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesActionsTest-1324976255 Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:34:27.343643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f461ddd7986842159c8e8177a7825435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f461ddd7986842159c8e8177a7825435"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f461ddd7986842159c8e8177a7825435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f461ddd7986842159c8e8177a7825435"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesActionsTest-1324976255 Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: f461ddd7986842159c8e8177a7825435 Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesActionsTest-1324976255 Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesActionsTest-1324976255-project Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: e9f9a02ea89f4991a3042c14cf869432 Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesActionsTest-1324976255-project Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance af465084-381b-4ab6-b67f-92458e0ed98c could not be found. Aug 09 12:34:27.345456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': 'af465084-381b-4ab6-b67f-92458e0ed98c'} Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af465084-381b-4ab6-b67f-92458e0ed98c could not be found. Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:34:27.346318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af465084-381b-4ab6-b67f-92458e0ed98c could not be found. Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af465084-381b-4ab6-b67f-92458e0ed98c could not be found. Aug 09 12:34:27.347718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:34:27.349008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] Returning 404 to user: Instance af465084-381b-4ab6-b67f-92458e0ed98c could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:34:27.349008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1faf3560-4d3f-4f4c-a83a-8cdbb7f11dcd tempest-VolumesActionsTest-1324976255 tempest-VolumesActionsTest-1324976255-project] 10.222.0.60 "GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c" status: 404 len: 111 microversion: 2.1 time: 0.036056 Aug 09 12:34:27.349008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 567/1143] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:27 2022] GET /compute/v2.1/servers/af465084-381b-4ab6-b67f-92458e0ed98c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:34:28.114155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:28.115359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:28.124739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:28.125235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:28.126369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:28.127073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:28.127695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:28.128121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:28.268275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:28.276184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-164dcbf7-a061-49ce-bed6-546c5a3066fb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.166442 Aug 09 12:34:28.276781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 577/1144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:28 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:28.542760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-89dc3568-f759-47d3-aef1-1542e1a59c27 req-c2d70158-a7e9-438c-a5ef-1e1f7bb284b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a368964e-2b12-4ec7-a757-4cf2796910ab", "name": "network-vif-plugged", "status": "completed", "tag": "547a0884-98cf-4ddd-b43b-9c8ffe94c31a"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:28.555030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-89dc3568-f759-47d3-aef1-1542e1a59c27 req-c2d70158-a7e9-438c-a5ef-1e1f7bb284b1 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:28.556145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-89dc3568-f759-47d3-aef1-1542e1a59c27 req-c2d70158-a7e9-438c-a5ef-1e1f7bb284b1 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:28.557205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-89dc3568-f759-47d3-aef1-1542e1a59c27 req-c2d70158-a7e9-438c-a5ef-1e1f7bb284b1 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:28.573173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-89dc3568-f759-47d3-aef1-1542e1a59c27 req-c2d70158-a7e9-438c-a5ef-1e1f7bb284b1 service nova] Creating event network-vif-plugged:547a0884-98cf-4ddd-b43b-9c8ffe94c31a for instance a368964e-2b12-4ec7-a757-4cf2796910ab on hv-cinder-85236 Aug 09 12:34:28.578495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-89dc3568-f759-47d3-aef1-1542e1a59c27 req-c2d70158-a7e9-438c-a5ef-1e1f7bb284b1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039381 Aug 09 12:34:28.579091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 568/1145] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:34:29.297330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:29.298883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:29.306052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:29.306683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:29.307135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:29.307826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:29.308281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:29.308738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:29.449296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:29.460822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f404c8df-2032-4193-b996-e8b0972e58b5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.167073 Aug 09 12:34:29.461535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 578/1146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:29 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:30.485972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:30.486616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:30.494143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:30.494777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:30.495206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:30.495886 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:30.496708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:30.497122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:30.647281 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:30.656729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-810062eb-cf52-4846-a689-f740f880555a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.176124 Aug 09 12:34:30.657260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 569/1147] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:30 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:31.686693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:31.687401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:31.695325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:31.695892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:31.696430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:31.697552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:31.698308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:31.698716 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:31.835439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:31.843369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a3f61f9d-62a0-4be4-b056-39e76c67a719 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.161824 Aug 09 12:34:31.843933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 579/1148] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:31 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:32.871012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:32.871987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:32.878385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:32.878865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:32.879299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:32.880010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:32.880470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:32.880940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:33.024180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:33.036303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6a487eaf-eae2-4514-8a2c-f514b39e357b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.172221 Aug 09 12:34:33.037587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 570/1149] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:32 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:34.063498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:34.064466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:34.074682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:34.075155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:34.075586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:34.076271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:34.076749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:34.077166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:34.223019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:34.234372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4d28dd2d-255e-4f83-b9ee-8aad4d21086a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.177373 Aug 09 12:34:34.235144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 580/1150] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:34 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:35.262267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:35.263039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:35.271941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:35.272624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:35.273202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:35.274116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:35.274715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:35.275277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:35.280938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:35.415993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:35.424421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f44d9e7b-31da-4d0a-9bca-dce17ace1aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.168423 Aug 09 12:34:35.424941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 571/1151] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:35 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:36.447811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:36.448761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:36.452513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:36.460582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:36.461320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:36.461982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:36.463040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:36.463734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:36.464419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:36.602850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:36.612148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b976b97-189f-4745-b116-62bbd31ab7b6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.170309 Aug 09 12:34:36.612951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 581/1152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:36 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:37.633850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:37.634533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:37.637130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:37.643322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:37.643801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:37.644231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:37.644956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:37.645408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:37.645830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:37.792760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:37.800704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cd3abe44-b134-48bf-950e-373d1a54acb4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.170730 Aug 09 12:34:37.801275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 572/1153] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:37 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:38.822526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:38.823099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:38.830016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:38.830424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:38.830855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:38.831540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:38.831991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:38.832417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:38.970907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:38.979049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4dca576-6caa-44ea-b4a9-697fd6516b5e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1574 microversion: 2.1 time: 0.160633 Aug 09 12:34:38.979612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 582/1154] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:38 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:40.001650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:40.002264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:40.008539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:40.009250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:40.009685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:40.010390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:40.010848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:40.011274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:40.168633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:40.180885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bcf7cb57-94bd-4ef7-afd3-84e82c2bdc8f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1561 microversion: 2.1 time: 0.183895 Aug 09 12:34:40.181819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 573/1155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:39 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:53.791352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:53.791903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:53.798414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:53.800017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:53.801843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:53.802993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:53.803195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:53.804222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:53.805063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:53.806063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:53.910294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lazy-loading 'services' on Instance uuid 3e522aa4-f477-478c-9f4c-39e0c4202b36 {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:34:53.993353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6e53f71f-3f95-4d9a-ae39-bf39266e5fa3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36/os-volume_attachments/d1bc9bae-99a4-48c2-9480-3b9e957e9ba8" status: 202 len: 0 microversion: 2.1 time: 0.205633 Aug 09 12:34:53.994333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 583/1156] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:34:53 2022] DELETE /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36/os-volume_attachments/d1bc9bae-99a4-48c2-9480-3b9e957e9ba8 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 12:34:56.213615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:56.214250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:56.216837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=3 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:56.217491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=16 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:56.223600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:56.224086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:56.224539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:56.225244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:56.225689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:56.226101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:56.256073 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:34:56.377625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c47d72e5-40d9-4c1e-b582-f7481fd59f71 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 204 len: 0 microversion: 2.1 time: 0.167643 Aug 09 12:34:56.378255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 574/1157] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:34:56 2022] DELETE /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:34:56.388452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:56.389848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:56.397117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:56.397811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:56.398424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:56.399496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:56.399945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:56.400359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:56.542511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:56.550642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45594ef7-3559-441f-9b28-9e0809789796 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1514 microversion: 2.1 time: 0.167608 Aug 09 12:34:56.564342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 584/1158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:56 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:34:57.572361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:57.573152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:57.580492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:57.580974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:57.581400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:57.582079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:57.582516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:57.582926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:57.713104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:57.721462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9f5efea2-1299-47f4-bc09-fdfa7faf8ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1514 microversion: 2.1 time: 0.153358 Aug 09 12:34:57.722023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 575/1159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:57 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:58.744713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:34:58.745403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:34:58.753910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:58.754652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:58.755169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:58.755875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:58.756348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:58.756792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:59.002283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:34:59.010702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89391f0a-2237-4053-afd3-1ba41afe6636 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 200 len: 1514 microversion: 2.1 time: 0.270321 Aug 09 12:34:59.011364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 585/1160] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:34:58 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:34:59.382521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-2540976e-c768-49e6-b9de-e1699ddb9344 req-c454b435-0d1f-4937-b7bf-b4644938d493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e522aa4-f477-478c-9f4c-39e0c4202b36", "name": "network-vif-deleted", "tag": "aaa1a38f-9266-45a9-a223-7009cbc288e0"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:34:59.394251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-2540976e-c768-49e6-b9de-e1699ddb9344 req-c454b435-0d1f-4937-b7bf-b4644938d493 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:34:59.394729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-2540976e-c768-49e6-b9de-e1699ddb9344 req-c454b435-0d1f-4937-b7bf-b4644938d493 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:34:59.395156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-2540976e-c768-49e6-b9de-e1699ddb9344 req-c454b435-0d1f-4937-b7bf-b4644938d493 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:34:59.406619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-2540976e-c768-49e6-b9de-e1699ddb9344 req-c454b435-0d1f-4937-b7bf-b4644938d493 service nova] Creating event network-vif-deleted:aaa1a38f-9266-45a9-a223-7009cbc288e0 for instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 on hv-cinder-85236 Aug 09 12:34:59.412295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-2540976e-c768-49e6-b9de-e1699ddb9344 req-c454b435-0d1f-4937-b7bf-b4644938d493 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033487 Aug 09 12:34:59.413042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 576/1161] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:35:00.033062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:00.034386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 3e522aa4-f477-478c-9f4c-39e0c4202b36] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:00.042771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:00.043230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:00.043890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:00.044642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:00.045251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:00.045685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:00.061514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] HTTP exception thrown: Instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 could not be found. Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Request method failure captured: Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 HTTP/1.1 Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lQi9t6AtNfKIFGfoDYSuBwFOa6W--Z_4JoqOv1MJFjTxDMRnr9NzZTFKSfWiRIvwnVH2g9HzAHchjrorEdM0oMigNwrM-VcZXrdAXDzrEJp63lO7k5HU2DRLXHNkr46XviNUP6arBCw2D5IOVuGd-1zG_oBk2MH0YtbGm5hUCnq5VM Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:35:00.063309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 1c6c4f7d2e6e42b38368cf3eaffc6187 Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 could not be found. Aug 09 12:35:00.065196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '3e522aa4-f477-478c-9f4c-39e0c4202b36'} Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 could not be found. Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:35:00.066266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 could not be found. Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 could not be found. Aug 09 12:35:00.068018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:35:00.069492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Returning 404 to user: Instance 3e522aa4-f477-478c-9f4c-39e0c4202b36 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:35:00.069492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acffa75f-953b-48bf-87a5-8f63ea34fc80 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36" status: 404 len: 111 microversion: 2.1 time: 0.037392 Aug 09 12:35:00.069492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 586/1162] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:00 2022] GET /compute/v2.1/servers/3e522aa4-f477-478c-9f4c-39e0c4202b36 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:35:16.281678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:16.282642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:16.287650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-519877310", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452", "networks": [{"uuid": "813d1549-babb-4fe4-8e58-2d6e8b0131c5"}]}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:35:16.348412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.network.neutron [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] validate_networks() for [('813d1549-babb-4fe4-8e58-2d6e8b0131c5', None, None, None, None, None)] {{(pid=117661) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:35:16.728975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Flavor limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:35:16.729580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Image limits 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:35:16.730242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Flavor pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:35:16.730746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Image pref 0:0:0 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:35:16.731125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.virt.hardware [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117661) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:35:16.745864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:16.746465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:16.747072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:16.748220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:16.748902 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:16.749558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:16.767623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Getting quotas for project e57ead005fcd46e4a751225d11d4f9e1. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:35:16.772541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.quota [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Getting quotas for user 1c6c4f7d2e6e42b38368cf3eaffc6187 and project e57ead005fcd46e4a751225d11d4f9e1. Resources: {'ram', 'cores', 'instances'} {{(pid=117661) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:35:16.784086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Going to run 1 instances... {{(pid=117661) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:35:16.786511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117661) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:35:16.838315 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-780d75b8-64db-4b5d-b4ab-1d294e5b55f6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558919 Aug 09 12:35:16.838962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 577/1163] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:35:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:35:16.851451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d981a243-c21a-402e-994e-b841769b1aaf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:16.852083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d981a243-c21a-402e-994e-b841769b1aaf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:16.856731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=8 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:16.857617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:16.918166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d981a243-c21a-402e-994e-b841769b1aaf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:16.925930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d981a243-c21a-402e-994e-b841769b1aaf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1218 microversion: 2.1 time: 0.079601 Aug 09 12:35:16.926773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 587/1164] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:16 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:17.949523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:17.950168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:17.957954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:17.958424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:17.958843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:17.959528 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:17.959972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:17.960397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:18.028992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:18.038076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2d6a7da1-3ac5-40ef-b1b7-b9b61780574c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1270 microversion: 2.1 time: 0.092382 Aug 09 12:35:18.038076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 578/1165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:17 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:19.060077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:19.060685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:19.067722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:19.068297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:19.068850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:19.069617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:19.070256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:19.070755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:19.267582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:19.276314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-57b5834f-6c3a-472f-82c2-6270538995ef tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1318 microversion: 2.1 time: 0.221822 Aug 09 12:35:19.277052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 588/1166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:19 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:19.501703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-ae555ab9-b795-4589-900e-11d692e2cf0a req-fb4619eb-862c-4d35-8361-5640d8a9f248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6409e8d1-b827-4649-83ea-b853a1f203ff", "tag": "9853ae88-f914-498a-ad3c-5291035573bc"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:35:19.512094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-ae555ab9-b795-4589-900e-11d692e2cf0a req-fb4619eb-862c-4d35-8361-5640d8a9f248 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:19.512618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-ae555ab9-b795-4589-900e-11d692e2cf0a req-fb4619eb-862c-4d35-8361-5640d8a9f248 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:19.513058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-ae555ab9-b795-4589-900e-11d692e2cf0a req-fb4619eb-862c-4d35-8361-5640d8a9f248 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:19.525688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-ae555ab9-b795-4589-900e-11d692e2cf0a req-fb4619eb-862c-4d35-8361-5640d8a9f248 service nova] Creating event network-changed:9853ae88-f914-498a-ad3c-5291035573bc for instance 6409e8d1-b827-4649-83ea-b853a1f203ff on hv-cinder-85236 Aug 09 12:35:19.530869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-ae555ab9-b795-4589-900e-11d692e2cf0a req-fb4619eb-862c-4d35-8361-5640d8a9f248 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Aug 09 12:35:19.531696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 579/1167] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:35:20.303760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:20.304780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:20.314678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:20.315165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:20.315631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:20.316324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:20.317086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:20.317649 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:20.447567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:20.458598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f58bb33-a21c-4c0a-8766-d9ebfa4f6e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1318 microversion: 2.1 time: 0.161520 Aug 09 12:35:20.459429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 589/1168] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:20 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:21.491658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:21.492825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:21.503864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:21.504913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:21.505648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:21.506769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:21.507510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:21.508205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:21.650453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:21.658116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-54cc77bb-1044-4012-9083-87ebe4554dd9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1318 microversion: 2.1 time: 0.174650 Aug 09 12:35:21.658662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 580/1169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:21 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:22.690289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:22.690860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:22.698146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:22.698631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:22.699069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:22.699763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:22.700219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:22.700676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:22.835668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:22.847031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5d9c488-d8f6-4bf1-a537-23202e23b1d6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1318 microversion: 2.1 time: 0.163442 Aug 09 12:35:22.847873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 590/1170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:22 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:23.877288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:23.878007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:23.885198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:23.885705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:23.886157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:23.886893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:23.887364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:23.887803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:24.022091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:24.029523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5659951-5fb6-4c72-95f1-1f6ead4fa6b8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1318 microversion: 2.1 time: 0.159328 Aug 09 12:35:24.030069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 581/1171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:23 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:25.053001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:25.053657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:25.060414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:25.060918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:25.061347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:25.062036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:25.062497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:25.062893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:25.201472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:25.209016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ada8588-36f2-43ea-afd2-c26efe9f7e45 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1318 microversion: 2.1 time: 0.161823 Aug 09 12:35:25.209794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 591/1172] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:25 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:25.262854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-1d28e210-9593-44e2-8fa6-8338b7ae9035 req-d5cbf344-9c48-4029-b3b8-d0d10c0ba3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6409e8d1-b827-4649-83ea-b853a1f203ff", "name": "network-vif-plugged", "status": "completed", "tag": "9853ae88-f914-498a-ad3c-5291035573bc"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:35:25.273355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-1d28e210-9593-44e2-8fa6-8338b7ae9035 req-d5cbf344-9c48-4029-b3b8-d0d10c0ba3a5 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:25.273819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-1d28e210-9593-44e2-8fa6-8338b7ae9035 req-d5cbf344-9c48-4029-b3b8-d0d10c0ba3a5 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:25.274221 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-1d28e210-9593-44e2-8fa6-8338b7ae9035 req-d5cbf344-9c48-4029-b3b8-d0d10c0ba3a5 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:25.285804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-1d28e210-9593-44e2-8fa6-8338b7ae9035 req-d5cbf344-9c48-4029-b3b8-d0d10c0ba3a5 service nova] Creating event network-vif-plugged:9853ae88-f914-498a-ad3c-5291035573bc for instance 6409e8d1-b827-4649-83ea-b853a1f203ff on hv-cinder-85236 Aug 09 12:35:25.290837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-1d28e210-9593-44e2-8fa6-8338b7ae9035 req-d5cbf344-9c48-4029-b3b8-d0d10c0ba3a5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031725 Aug 09 12:35:25.291698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 582/1173] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:35:26.233856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:26.234752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:26.245563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:26.246355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:26.247035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:26.248656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:26.249400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:26.250087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:26.384095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:26.391852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cda6cd6b-a119-4938-9cd3-cc3a8688a049 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1318 microversion: 2.1 time: 0.164965 Aug 09 12:35:26.392712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 592/1174] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:26 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:27.410421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:27.412756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=6 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:27.416566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:27.417390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:27.423787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:27.424205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:27.424670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:27.425373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:27.425825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:27.426325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:27.572663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:27.580338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-86ac4127-014b-48a4-8902-b7a7ee89f8ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1318 microversion: 2.1 time: 0.171561 Aug 09 12:35:27.580932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 583/1175] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:27 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:35:28.604471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:28.605349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:28.607691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:28.615452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:28.616031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:28.616523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:28.617215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:28.617663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:28.618284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:28.749456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:28.760665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e53240fa-5af2-46b1-96b3-cf0f0dc465b0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1506 microversion: 2.1 time: 0.162108 Aug 09 12:35:28.761503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 593/1176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:28 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:28.784962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f74ddc2e-c47f-4ff3-9bae-fc7e15da010b", "device": "/dev/sdb"}} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:35:28.787827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:28.794471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:28.794953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:28.795393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:28.796084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:28.796574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:28.796971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:29.077494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3253bd75-c144-4e7a-9878-25ede04dc713 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "POST /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296530 Aug 09 12:35:29.078103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 584/1177] 10.222.0.60 () {60 vars in 1323 bytes} [Tue Aug 9 12:35:28 2022] POST /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:35:57.691846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-635040872", "imageRef": "c5b22aea-0ebc-4f37-8b47-93ee04280b79", "flavorRef": "452"}} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:35:57.699000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=16 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:57.700036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=36 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:57.753486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.network.neutron [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] validate_networks() for None {{(pid=117660) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 12:35:58.030258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Flavor limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 12:35:58.030675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Image limits 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 12:35:58.031136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Flavor pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 12:35:58.031550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Image pref 0:0:0 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 12:35:58.031941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.virt.hardware [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117660) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 12:35:58.042624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:58.043094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:58.043519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:58.044226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:58.044702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:58.045121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:58.062358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Getting quotas for project 8d213e4a7f904eb0b8a21baaeeb1c22a. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 12:35:58.066726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.quota [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Getting quotas for user 57cccf3c12fa446ea861ff20a7fabf48 and project 8d213e4a7f904eb0b8a21baaeeb1c22a. Resources: {'ram', 'cores', 'instances'} {{(pid=117660) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 12:35:58.078126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Going to run 1 instances... {{(pid=117660) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 12:35:58.080762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5b22aea-0ebc-4f37-8b47-93ee04280b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117660) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 12:35:58.126878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42e8c37d-0155-469a-bbcf-0f4fbf6b7dcd tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.439445 Aug 09 12:35:58.127406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 594/1178] 10.222.0.60 () {60 vars in 1147 bytes} [Tue Aug 9 12:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 12:35:58.136491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:58.137310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:58.141638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20d54199-fe9f-4267-b450-85b4d1076b27 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:58.142654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20d54199-fe9f-4267-b450-85b4d1076b27 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:58.198882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20d54199-fe9f-4267-b450-85b4d1076b27 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:58.206131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20d54199-fe9f-4267-b450-85b4d1076b27 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1214 microversion: 2.1 time: 0.071442 Aug 09 12:35:58.206677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 585/1179] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:58 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:35:59.231404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:35:59.232219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:35:59.243036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:59.243842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:59.244658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:59.245896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:35:59.246694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:35:59.247326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:35:59.317726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:35:59.329318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e1508e1-761b-4fe4-8628-e915bb721b89 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1218 microversion: 2.1 time: 0.105420 Aug 09 12:35:59.330205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 595/1180] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:35:59 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:00.353321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:00.353974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:00.361943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:00.362508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:00.362980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:00.363759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:00.364266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:00.364706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:00.440755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:00.452124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-34581b70-6bdc-4627-a12c-5bbb09a5d87e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1218 microversion: 2.1 time: 0.103784 Aug 09 12:36:00.453222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 586/1181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:00 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:01.482220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:01.485748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:01.492587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:01.493070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:01.493496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:01.494191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:01.494635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:01.495063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:01.561658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:01.569410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8221707c-9984-42bd-8c10-4900ca6d4544 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1266 microversion: 2.1 time: 0.091351 Aug 09 12:36:01.569970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 596/1182] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:01 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:02.227584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:02.228127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:02.237734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:02.238813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:02.239439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:02.241708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:02.242557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:02.243513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:02.276783 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:36:02.402093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-399c9358-6b48-4c58-98e3-9658337ef41d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 204 len: 0 microversion: 2.1 time: 0.178771 Aug 09 12:36:02.403109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 587/1183] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:36:02 2022] DELETE /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:36:02.423651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:02.426820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:02.438206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:02.439181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:02.441341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:02.442373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:02.443744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:02.444406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:02.451722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-93dd55a9-c180-40e1-93f2-e4817efb6b0b req-b4181b1b-8826-4122-b431-a009e19e0648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091", "tag": "360d1d5b-897e-40a1-93d7-e97dbff856e7"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:36:02.480262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-93dd55a9-c180-40e1-93f2-e4817efb6b0b req-b4181b1b-8826-4122-b431-a009e19e0648 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:02.482412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-93dd55a9-c180-40e1-93f2-e4817efb6b0b req-b4181b1b-8826-4122-b431-a009e19e0648 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:02.483011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-93dd55a9-c180-40e1-93f2-e4817efb6b0b req-b4181b1b-8826-4122-b431-a009e19e0648 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:02.499133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-93dd55a9-c180-40e1-93f2-e4817efb6b0b req-b4181b1b-8826-4122-b431-a009e19e0648 service nova] Creating event network-changed:360d1d5b-897e-40a1-93d7-e97dbff856e7 for instance f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 on hv-cinder-85236 Aug 09 12:36:02.505020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-93dd55a9-c180-40e1-93f2-e4817efb6b0b req-b4181b1b-8826-4122-b431-a009e19e0648 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274812 Aug 09 12:36:02.510093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 597/1184] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:36:02.591820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:02.592553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:02.599288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:02.600067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:02.600661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:02.601381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:02.602197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:02.602610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:02.692505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:02.700685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-09a5788a-620b-4bf1-9a99-d9810dae3b93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1577 microversion: 2.1 time: 0.293115 Aug 09 12:36:02.710013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 588/1185] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:02 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1577 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:02.723417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:02.732147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-87e8cacc-f88f-4f2d-bdd6-91e7b42e8276 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1272 microversion: 2.1 time: 0.144572 Aug 09 12:36:02.733021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 598/1186] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:02 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:36:03.723967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:03.724612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:03.731421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:03.731898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:03.732320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:03.733036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:03.733483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:03.733900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:03.754016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:03.754577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:03.761311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:03.761791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:03.762218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:03.762906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:03.763348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:03.763766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:03.930149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:03.938096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9dcab17b-fa7d-4078-ad8f-be5c416d82e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1577 microversion: 2.1 time: 0.218414 Aug 09 12:36:03.944728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 589/1187] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:03 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:03.945070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:03.949214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e65c1a22-0901-4ad3-a09f-3f9996aa60ac tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.199069 Aug 09 12:36:03.949753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 599/1188] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:03 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:04.961939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:04.962692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:04.971467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:04.972124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:04.972365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:04.972977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:04.973296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:04.973619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:04.974254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:04.974818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:04.982163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:04.982815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:04.983424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:04.984600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:04.985414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:04.986006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:05.172083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:05.176946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:05.180155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6ceb170d-96ae-4b9c-8ea4-027d862bf7f0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1577 microversion: 2.1 time: 0.223469 Aug 09 12:36:05.180962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 590/1189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:04 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:05.186629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ac6a8e9-8f59-4af2-a379-19308f23d0ce tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.219380 Aug 09 12:36:05.187673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 600/1190] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:04 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:06.205614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:06.206200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:06.208943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:06.209556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:06.212879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:06.213359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:06.213782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:06.214476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:06.214929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:06.215343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:06.216288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:06.216819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:06.217248 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:06.217934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:06.218384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:06.218800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:06.419522 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:06.421454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:06.427653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fbbbf960-b171-429b-87b1-748456d074de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1577 microversion: 2.1 time: 0.226210 Aug 09 12:36:06.428227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 591/1191] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:06 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:06.429118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-024ab682-cece-47c3-abaf-b10ae8dc7e36 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.223981 Aug 09 12:36:06.429674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 601/1192] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:06 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:07.449799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:07.450592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:07.450713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:07.451095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:07.458541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:07.459310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:07.459451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:07.459715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:07.460065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:07.460649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:07.461034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:07.461166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:07.461497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:07.462418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:07.463093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:07.463832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:07.703404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:07.714152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1c0c54fd-6029-4419-803c-8424da050157 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1577 microversion: 2.1 time: 0.268632 Aug 09 12:36:07.715298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 592/1193] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:07 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1577 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:07.746061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:07.768616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa01015b-4f58-4ae0-8c8b-487aba37fb2c tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.317518 Aug 09 12:36:07.778424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 602/1194] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:07 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:07.805172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-9bcaef04-59ce-406c-99d2-a202101ad9c0 req-04cc1443-db77-420a-9a9e-94eb0f269e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561b5a09-d3cd-46ea-80fc-ca65bcab62e2", "tag": "b036aa49-6ed0-484d-861d-6cfafcb9efe2"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:36:07.816101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9bcaef04-59ce-406c-99d2-a202101ad9c0 req-04cc1443-db77-420a-9a9e-94eb0f269e32 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:07.816907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9bcaef04-59ce-406c-99d2-a202101ad9c0 req-04cc1443-db77-420a-9a9e-94eb0f269e32 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:07.817396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-9bcaef04-59ce-406c-99d2-a202101ad9c0 req-04cc1443-db77-420a-9a9e-94eb0f269e32 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:07.835667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-9bcaef04-59ce-406c-99d2-a202101ad9c0 req-04cc1443-db77-420a-9a9e-94eb0f269e32 service nova] Creating event network-changed:b036aa49-6ed0-484d-861d-6cfafcb9efe2 for instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 on hv-cinder-85236 Aug 09 12:36:07.840861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-9bcaef04-59ce-406c-99d2-a202101ad9c0 req-04cc1443-db77-420a-9a9e-94eb0f269e32 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039979 Aug 09 12:36:07.841449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 593/1195] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:36:08.744683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:08.745586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:08.749054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:08.750208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell0:SELECT=6 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:08.762165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:08.763020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:08.763745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:08.764973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:08.765771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:08.766470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:08.791908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:08.792633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:08.794884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell0:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:08.800804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:08.801287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:08.802740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:08.803550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:08.804004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:08.804416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:08.971340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:08.978078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:08.979364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0759b3b0-1d35-44e5-be70-6d982f3ebdd2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.242002 Aug 09 12:36:08.979938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 603/1196] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:08 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:08.986057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4b6c1e82-a573-4b37-a3b8-0c230e5fc6d0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.199695 Aug 09 12:36:08.986610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 594/1197] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:08 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:10.005332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:10.006369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:10.011510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:10.012557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:10.018123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:10.018800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:10.019239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:10.020054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:10.020741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:10.021167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:10.021477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:10.021962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:10.022380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:10.023077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:10.023612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:10.023951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:10.220824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:10.224210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:10.228509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c7d684cf-6c46-4414-9901-4e79892c29db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.230029 Aug 09 12:36:10.229051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 604/1198] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:09 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:10.231768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b782ed59-dc84-4092-a62a-70a084762e37 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.227006 Aug 09 12:36:10.232562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 595/1199] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:10 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:11.254186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:11.254805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:11.255202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:11.255313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:11.261634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:11.262001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:11.262163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:11.262479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:11.262630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:11.262883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:11.263217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:11.263797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:11.263947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:11.264068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:11.264170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:11.264421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:11.465208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:11.472220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:11.473342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9f047e4e-5fad-4fa7-8c29-2116f0daf0bf tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.223474 Aug 09 12:36:11.474255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 596/1200] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:11 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:11.479181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-09e80125-079f-41c3-95ba-ef94fa6da057 req-4e270abd-617f-4b2c-926d-53b6583f3262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091", "name": "network-vif-unplugged", "status": "completed", "tag": "360d1d5b-897e-40a1-93d7-e97dbff856e7"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:36:11.480819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dbfd636a-e559-4778-9d5f-02351f54238f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.232115 Aug 09 12:36:11.481219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 605/1201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:11 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:11.489523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-09e80125-079f-41c3-95ba-ef94fa6da057 req-4e270abd-617f-4b2c-926d-53b6583f3262 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:11.489988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-09e80125-079f-41c3-95ba-ef94fa6da057 req-4e270abd-617f-4b2c-926d-53b6583f3262 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:11.490405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-09e80125-079f-41c3-95ba-ef94fa6da057 req-4e270abd-617f-4b2c-926d-53b6583f3262 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:11.505933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-09e80125-079f-41c3-95ba-ef94fa6da057 req-4e270abd-617f-4b2c-926d-53b6583f3262 service nova] Creating event network-vif-unplugged:360d1d5b-897e-40a1-93d7-e97dbff856e7 for instance f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 on hv-cinder-85236 Aug 09 12:36:11.511574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-09e80125-079f-41c3-95ba-ef94fa6da057 req-4e270abd-617f-4b2c-926d-53b6583f3262 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036184 Aug 09 12:36:11.512205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 597/1202] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:36:12.499513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:12.500609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:12.508899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:12.509995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:12.511375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:12.512167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:12.512936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:12.514078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:12.514833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:12.515534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:12.519341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:12.519818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:12.520242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:12.520951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:12.521400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:12.521849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:12.721427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:12.725205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:12.729471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ba8aef4-654c-4aec-86da-69530bf31daa tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.236970 Aug 09 12:36:12.730053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 606/1203] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:12 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:12.733103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5274ef9e-8246-4ab0-bb91-e08cf58f3a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.232529 Aug 09 12:36:12.733673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 598/1204] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:12 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:13.754674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:13.755642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:13.757637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:13.758612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:13.766491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:13.767280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:13.767935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:13.768848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:13.769047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:13.769298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:13.769544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:13.769730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:13.769976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:13.770671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:13.771123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:13.771545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:13.968421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:13.971842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:13.976800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7c3f887-1ae0-4ced-882b-1cf909104434 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.229500 Aug 09 12:36:13.977373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 607/1205] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:13 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:13.979706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce633a52-3ebd-4d9c-bc0a-9c97eddc0227 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.228656 Aug 09 12:36:13.980238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 599/1206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:13 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:14.997609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:14.998282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:15.001807 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:15.003214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:15.005660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:15.006150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:15.006678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:15.007288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:15.007770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:15.008202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:15.009866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:15.010354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:15.010778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:15.011447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:15.011915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:15.012338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:15.206867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:15.210324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:15.214596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-94210a87-553e-4846-b3e5-75a8c4d8a4f7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.221009 Aug 09 12:36:15.215152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 608/1207] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:14 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:15.218299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46db25f3-8070-4b67-8c5f-8da43e45d280 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.221029 Aug 09 12:36:15.218996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 600/1208] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:14 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:16.239261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:16.239901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:16.247099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:16.247325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:16.247784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:16.247906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:16.248007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:16.249265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:16.249642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:16.250084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:16.255515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:16.255952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:16.256408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:16.257169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:16.257637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:16.258079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:16.455805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:16.459717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:16.463961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed09a3c1-aced-4b70-af81-3a83178b2064 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.230454 Aug 09 12:36:16.464827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 609/1209] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:16 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:16.467735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-57811ae9-21e9-4989-8d81-173201fd9615 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.224592 Aug 09 12:36:16.468471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 601/1210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:16 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:17.488885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:17.489617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:17.491226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:17.491864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:17.496616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:17.497116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:17.497577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:17.498284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:17.498703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:17.499197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:17.499464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:17.499580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:17.499938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:17.500650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:17.501091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:17.501494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:17.505753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:17.703361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:17.707947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:17.712194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3720c68d-9ad8-4152-a8bf-c45fa932fae2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.229116 Aug 09 12:36:17.714479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 610/1211] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:17 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:17.719005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-014e2dcd-80a8-4f9b-9276-6e0b1e824752 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.231947 Aug 09 12:36:17.719729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 602/1212] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:17 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:18.735427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:18.736775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:18.740762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:18.741487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:18.744818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:18.744983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:18.745386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:18.746085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:18.746567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:18.746983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:18.747979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:18.748465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:18.749238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:18.749937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:18.750397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:18.750805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:18.950428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:18.956573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:18.960249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9fe44e8d-c5c7-4ab5-8b46-45d5fe49156e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.223449 Aug 09 12:36:18.960579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:18.961211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 603/1213] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:18 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:18.966076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0a4d2d8b-4c1f-40ef-8688-a9f502e5c2a8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.234566 Aug 09 12:36:18.966659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 611/1214] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:18 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:19.980935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:19.981495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:19.987723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:19.988282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:19.988424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:19.989001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:19.989449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:19.990288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:19.990750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:19.991172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:19.995042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:19.995506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:19.995941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:19.996644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:19.997091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:19.997519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:20.186626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:20.190283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:20.194464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a71a014d-b828-45b7-a462-c16e13243ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.217638 Aug 09 12:36:20.195046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 604/1215] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:19 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:20.198105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e85198d-e22b-4db7-9112-45cbc6ba9acb tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.214632 Aug 09 12:36:20.198626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 612/1216] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:19 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:21.216010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:21.216620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:21.218921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:21.219517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:21.223293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:21.223803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:21.224243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:21.224997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:21.225415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:21.225871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:21.226022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:21.226504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:21.226915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:21.227598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:21.228046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:21.228489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:21.423455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:21.425464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:21.431735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8e18d6a4-47e2-48ed-bfa6-55d41fbc5159 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.216610 Aug 09 12:36:21.432339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 613/1217] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:21 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:21.433603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2cd1e807-75f9-4670-b5eb-bc998e7ee3e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.221506 Aug 09 12:36:21.434150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 605/1218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:21 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:22.456793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:22.457800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:22.458839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:22.459878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:22.468465 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:22.469301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:22.470116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:22.470467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:22.471252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:22.471520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:22.471989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:22.472207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:22.472712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:22.473231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:22.473941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:22.474393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:22.669491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:22.674434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:22.679749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e5748bb0-fa82-4379-8a41-5b6d678c8647 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.229514 Aug 09 12:36:22.680328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 614/1219] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:22 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:22.683347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4eb26b83-e44b-4e4f-8698-60c0de3f82e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.230973 Aug 09 12:36:22.683911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 606/1220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:22 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:23.705168 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:23.706148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:23.708025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:23.708766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:23.713727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:23.714277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:23.714624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:23.715323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:23.715441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:23.715774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:23.715938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:23.716197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:23.716677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:23.717517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:23.718258 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:23.718706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:23.913069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:23.916774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:23.920828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b6f094a7-03a3-446f-9936-aa44dd309349 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.222223 Aug 09 12:36:23.921382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 615/1221] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:23 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:23.924596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-885c98a9-aa53-4d8f-9a69-6ed1d1f51bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.222959 Aug 09 12:36:23.925148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 607/1222] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:23 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:24.946590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:24.947632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:24.950701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:24.951723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:24.958728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:24.959217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:24.959684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:24.960470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:24.960947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:24.961372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:24.961863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:24.962346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:24.962773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:24.963473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:24.963920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:24.964341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:25.159381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:25.164683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:25.170414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-01a89e91-ce01-4a08-b1f8-6a251ef43c60 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.230579 Aug 09 12:36:25.171140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 616/1223] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:24 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:25.175711 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d9e822a7-de0c-48f8-8c0c-b53d65c9072e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.231447 Aug 09 12:36:25.176498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 608/1224] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:24 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:26.196996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:26.197777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:26.199941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:26.200758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:26.206724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:26.207358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:26.207931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:26.208902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:26.209202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:26.209475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:26.209843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:26.210097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:26.210418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:26.211305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:26.211900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:26.212482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:26.406223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:26.410664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:26.414776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bd0621f0-24c8-47ee-9d31-55a30a21ed06 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.222945 Aug 09 12:36:26.415390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 617/1225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:26 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:26.418958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a8145ac4-e7ae-4f3c-8bae-433a107292b2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.224070 Aug 09 12:36:26.419662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 609/1226] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:26 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:27.436810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:27.437402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:27.440537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:27.441143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:27.444352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:27.444870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:27.445323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:27.446057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:27.446497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:27.446919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:27.448170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:27.448682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:27.449111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:27.449800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:27.450245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:27.450663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:27.656574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:27.659723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:27.666806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4c1fa10-957d-4fe0-8b5f-eda9c1da8fd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.229670 Aug 09 12:36:27.667216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5da931b4-be9d-4945-8b48-55ced64998e3 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.235001 Aug 09 12:36:27.668359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 610/1227] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:27 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:27.668569 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 618/1228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:27 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:28.688155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:28.688849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:28.689263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:28.689405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:28.691021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:28.691159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:28.695928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:28.696445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:28.696873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:28.696998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:28.697470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:28.697643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:28.697923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:28.698330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:28.698742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:28.698853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:28.699198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:28.699624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:28.893635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:28.896762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:28.901633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-00d6476c-91d6-424a-813c-33caffddbfec tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.217436 Aug 09 12:36:28.902570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 611/1229] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:28 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:28.904707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc504628-e248-4466-9233-3da93b91936a tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.220459 Aug 09 12:36:28.905285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 619/1230] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:28 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:29.922837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:29.923417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:29.925623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:29.926230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:29.930102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:29.930583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:29.931011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:29.931696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:29.932137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:29.932590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:29.932788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:29.933118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:29.933671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:29.934376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:29.934866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:29.935277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:30.128136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:30.132858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:30.139688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-28e1dc50-738e-4719-a2fd-b33c6cfa207d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.220690 Aug 09 12:36:30.143261 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 612/1231] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:29 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:30.143449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d81393f-4ad2-40e7-8e15-61dd822f7db5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.220751 Aug 09 12:36:30.143449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 620/1232] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:29 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:31.166472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:31.167535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:31.167650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:31.168128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:31.174321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:31.174777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:31.174939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:31.175226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:31.175358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:31.175657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:31.175922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:31.176342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:31.176477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:31.176826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:31.176952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:31.177227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:31.372099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:31.375511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:31.380284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-369e1efd-f5df-4ef3-a222-ed8f80f3472c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.220912 Aug 09 12:36:31.380982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 613/1233] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:31 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:31.383091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-633e23ff-74c4-4bba-9070-6708bf708cc5 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.222028 Aug 09 12:36:31.383654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 621/1234] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:31 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:32.402926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:32.403728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:32.404138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:32.404786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:32.410260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:32.410747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:32.411191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:32.411450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:32.411858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:32.412009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:32.412342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:32.412531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:32.412789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:32.413075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:32.413523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:32.413971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:32.605173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:32.608956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:32.613254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a612ff3-ddd6-4945-9996-3cbdea6bed76 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.213074 Aug 09 12:36:32.613831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 622/1235] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:32 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:32.616811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c2c1f4ed-f250-4c10-a9b3-b92a6b2eaffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.218286 Aug 09 12:36:32.617831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 614/1236] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:32 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:33.638303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:33.638881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:33.641576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:33.642097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:33.645593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:33.646155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:33.646585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:33.647287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:33.647726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:33.648142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:33.648257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:33.648673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:33.649109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:33.649796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:33.650243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:33.650658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:33.847571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:33.850877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:33.855627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-54b5fbc9-683c-4d38-a7c8-1584e34db0e2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.223659 Aug 09 12:36:33.856225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 623/1237] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:33 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:33.859117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6272e041-0a10-48d7-a657-0e2442169490 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.222188 Aug 09 12:36:33.859719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 615/1238] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:33 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:34.880752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:34.881952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:34.884577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:34.885576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:34.891856 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:34.892367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:34.892824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:34.893534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:34.893890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:34.894011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:34.894375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:34.894508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:34.894803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:34.895495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:34.895944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:34.896362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:35.089847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:35.094004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:35.097697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76042e94-da49-46ed-97e2-9124d6d5cb07 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.223835 Aug 09 12:36:35.098253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 624/1239] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:34 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:35.101673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-27d2f190-2174-410c-ac7e-3b0833dbc119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.223471 Aug 09 12:36:35.102233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 616/1240] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:34 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:36.122040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:36.122862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:36.125418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:36.126026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:36.130054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:36.130546 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:36.130980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:36.131674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:36.132119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:36.132414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:36.132538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:36.132935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:36.133361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:36.134027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:36.134471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:36.134887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:36.600219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:36.605116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:36.608269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b384c1df-f65a-4f42-8742-74f606ba375e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.492332 Aug 09 12:36:36.608863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 625/1241] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:36 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:36.613592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e2c7b464-4689-481c-9bec-dfa21d741671 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.493217 Aug 09 12:36:36.614157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 617/1242] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:36 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:37.633998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:37.635225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:37.638773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:37.639737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:37.646366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:37.647167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:37.647896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:37.649088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:37.649873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:37.650433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:37.650759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:37.651232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:37.651946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:37.653132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:37.653955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:37.654349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:37.847259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:37.851698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:37.855080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ad8b32c-d1f3-4481-8689-ac0d1ec9655e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.227953 Aug 09 12:36:37.855232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:37.855864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 626/1243] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:37 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:37.860404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f366705f-c8fd-4849-9bbc-d6d417f1c352 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.228051 Aug 09 12:36:37.860980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 618/1244] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:37 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:38.877818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:38.878394 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:38.882391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:38.882962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:38.886884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:38.887376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:38.887800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:38.888544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:38.888999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:38.889415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:38.889812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:38.890309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:38.890810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:38.891705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:38.891866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:38.892282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:39.082262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:39.087154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:39.094383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16542209-6a2f-43cb-b7a4-de2782f55574 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.220741 Aug 09 12:36:39.095006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 627/1245] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:38 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:39.096920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7727d6b0-a17b-46d5-b5dd-efc060c489eb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.218853 Aug 09 12:36:39.097632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 619/1246] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:38 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:40.121320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:40.122290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:40.122930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:40.123124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:40.134366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:40.134734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:40.135170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:40.135453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:40.135892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:40.136185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:40.137159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:40.137411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:40.137953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:40.138207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:40.138656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:40.138910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:40.159261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:40.336703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:40.341271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:40.345011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-541346bf-6dfd-4ff3-94a6-9903e492003b tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.231232 Aug 09 12:36:40.345627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 628/1247] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:40 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:40.349052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1bb1d6f8-61b1-4031-bf51-60fac4822142 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.233842 Aug 09 12:36:40.349587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 620/1248] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:40 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:41.370708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:41.371692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:41.373930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:41.375448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:41.379754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:41.380235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:41.380664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:41.381381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:41.381830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:41.381996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:41.382249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:41.382491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:41.382920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:41.383610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:41.384066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:41.384517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:41.580763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:41.584422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:41.588365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-352c7d2e-3734-4c34-8f77-fb70947c887e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.224494 Aug 09 12:36:41.588973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 629/1249] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:41 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:41.592291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-16f03db3-7a42-47f2-b2fa-66fed27e7df8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.224872 Aug 09 12:36:41.592907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 621/1250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:41 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:42.613139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:42.613980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:42.616052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:42.616724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:42.622954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:42.623611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:42.624192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:42.625506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:42.625829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:42.626169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:42.626482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:42.626682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:42.627028 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:42.627641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:42.628238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:42.628834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:42.830855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:42.833894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:42.838595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-666299cb-2ad4-4937-93fe-9f4a92c31c78 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.227924 Aug 09 12:36:42.839260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 622/1251] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:42 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:42.841920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-470e8b27-9308-4341-818f-40dcda45f4c8 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.234986 Aug 09 12:36:42.842576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 630/1252] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:42 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:43.862503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:43.863072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:43.864344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:43.864971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:43.869938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:43.870426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:43.870851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:43.871539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:43.871691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:43.872034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:43.872204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:43.872477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:43.872628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:43.873175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:43.873622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:43.874037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:44.069104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:44.072337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:44.077447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-687b41cf-a05a-47ea-86cf-eb8555dfa3be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.219697 Aug 09 12:36:44.078254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 623/1253] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:43 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:44.080447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-970919f4-2412-4087-9b1c-55792b5db5e4 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.220055 Aug 09 12:36:44.081042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 631/1254] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:43 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:36:45.100306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:45.100932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:45.101345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:45.101536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:45.107496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:45.107970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:45.108278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:45.108430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:45.108804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:45.109186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:45.109702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:45.110020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:45.110452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:45.110578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:45.110938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:45.111429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:45.304200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:45.311544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:45.312133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9acb131b-8cfb-4a9c-b727-715325b7a331 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.216076 Aug 09 12:36:45.313397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 624/1255] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:45 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:45.319303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-514138a8-7c58-4406-a810-1b5188441609 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.222173 Aug 09 12:36:45.319858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 632/1256] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:45 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:46.338901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:46.339808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:46.344485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:46.345750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:46.351112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:46.351917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:46.352698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:46.353825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:46.354647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:46.355368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:46.356643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:46.357444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:46.358161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:46.359332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:46.359898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:46.360327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:46.554032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:46.558724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:46.564913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3587c8f9-0878-4317-98a1-3cd05e1b9144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.232998 Aug 09 12:36:46.565495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 625/1257] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:46 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:46.567486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-363c85fd-b327-46d3-a465-651286f8f75f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.229567 Aug 09 12:36:46.568077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 633/1258] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:46 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:47.590982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:47.591916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:47.592658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:47.592851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:47.603153 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:47.604077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:47.604634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:47.604917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:47.605430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:47.606001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:47.606256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:47.606741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:47.607262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:47.607516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:47.608024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:47.608768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:47.805175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:47.808554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:47.813985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3c016a56-67b9-43ba-a010-b7c6877dc5cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.229479 Aug 09 12:36:47.815372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 626/1259] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:47 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:47.816565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea13f2a1-bc93-41c6-a698-0f911224e267 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.230977 Aug 09 12:36:47.817094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 634/1260] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:47 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:48.838710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:48.839504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:48.840062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:48.840219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:48.846964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:48.847348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:48.847517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:48.847830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:48.847995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:48.848257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:48.848581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:48.848979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:48.849093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:48.849421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:48.849540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:48.849823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:49.046582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:49.050007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:49.054363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c5610ee-a079-40cd-b0d7-4e82240ea09d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.220755 Aug 09 12:36:49.055251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 635/1261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:48 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:49.057964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-19808381-0196-4d95-b4f5-2f72e54b78a2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.224344 Aug 09 12:36:49.058528 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 627/1262] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:48 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:50.079524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:50.080145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:50.082263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:50.082930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:50.087389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:50.087909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:50.088357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:50.089146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:50.089628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:50.089805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:50.090079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:50.090237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:50.090686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:50.091420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:50.091893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:50.092333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:50.288234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:50.296407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:50.297989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa16d419-159f-47c7-bb50-0678b0472b81 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.224313 Aug 09 12:36:50.298879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 636/1263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:50 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:50.308965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2161f748-e33a-46ef-9751-4fbc7acadc1d tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.230619 Aug 09 12:36:50.309846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 628/1264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:50 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:51.329115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:51.329869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:51.336345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:51.337149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:51.337947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:51.338503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:51.339003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:51.339821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:51.340356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:51.340910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:51.344410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:51.345009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:51.345516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:51.346485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:51.347189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:51.347731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:51.540349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:51.545056 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:51.550081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-744d1ac1-571e-4baa-a4ec-a64ba8c873f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.228072 Aug 09 12:36:51.550637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 637/1265] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:51 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:51.554630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-40d7b4c7-efc6-475e-a166-5ed81832bb05 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.222682 Aug 09 12:36:51.555419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 629/1266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:51 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:52.582318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:52.583275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:52.586864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:52.587878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:52.593930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:52.594419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:52.594851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:52.595554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:52.596006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:52.596423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:52.596661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:52.597148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:52.597585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:52.598280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:52.598755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:52.599179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:52.798486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:52.802026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:52.806314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5bec0bb1-52e6-4131-92bf-07df5d169eeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.230546 Aug 09 12:36:52.806889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 638/1267] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:52 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:52.809449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-14049fdb-2d1c-431d-a1ab-90a2f67e6b11 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.229137 Aug 09 12:36:52.810029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 630/1268] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:52 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:53.828711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:53.829451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:53.830219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:53.830860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:53.836500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:53.836985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:53.837409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:53.837863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:53.838114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:53.838347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:53.838516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:53.838769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:53.838939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:53.839467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:53.839941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:53.840341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:54.034922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:54.040370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:54.045515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5af173be-e40f-416b-80b3-42cd10efecc7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.219200 Aug 09 12:36:54.046252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 631/1269] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:53 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:54.050792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8692da6-f4ac-4042-907b-546d9f2d21a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.225946 Aug 09 12:36:54.051505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 639/1270] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:53 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:55.076588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:55.077585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:55.079067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:55.079672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:55.084130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:55.084658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:55.085096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:55.085804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:55.086133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:55.086254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:55.086617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:55.086749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:55.087049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:55.087741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:55.088228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:55.088675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:55.279367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:55.283879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:55.287181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-813261b5-07c4-45a0-832d-3570ed0d0134 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.217423 Aug 09 12:36:55.287794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 632/1271] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:55 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:55.292290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d2d4b06e-d603-4928-ab9c-fa50ce52d1ad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.219324 Aug 09 12:36:55.292866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 640/1272] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:55 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:56.310689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:56.311415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:56.315008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:56.315680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:56.318782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:56.319289 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:56.319737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:56.320498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:56.320985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:56.321506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:56.322537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:56.323045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:56.323503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:56.324231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:56.324736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:56.325235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:56.458118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:56.465538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1de84ba1-6538-44c3-9452-a69622acc908 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.159685 Aug 09 12:36:56.466098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 633/1273] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:56 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:56.594713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:56.602851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84ca64c5-4ec9-43c5-88df-e051618a2486 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.292583 Aug 09 12:36:56.603423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 641/1274] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:56 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:57.486782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:57.487487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:57.494372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:57.494873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:57.495277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:57.495965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:57.496451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:57.496835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:57.623130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:57.623739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:57.630846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:57.631242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:57.631673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:57.632398 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:57.632841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:57.633264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:57.717471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:57.725538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-690d1a29-f8ca-4bac-a816-6df10440716f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.242807 Aug 09 12:36:57.726121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 634/1275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:57 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:57.782319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:57.791575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aac52519-bed4-4a72-8333-e8076871ea2f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.171286 Aug 09 12:36:57.792166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 642/1276] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:57 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:58.751248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:58.752243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:58.754168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=48 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:58.759541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:58.760020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:58.760468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:58.761157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:58.761602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:58.762014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:58.780136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:58.813692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:58.814329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:58.816198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=48 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:58.821466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:58.821950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:58.822411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:58.823107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:58.823609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:58.824036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:58.933906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:58.942759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d2c824a0-cf19-4155-b593-b26121f16188 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.198045 Aug 09 12:36:58.943342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 635/1277] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:58 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:36:58.981171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:36:58.989299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d803c1a0-0dad-41f2-9d5e-d51944108c97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.180074 Aug 09 12:36:58.989833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 643/1278] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:58 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:36:59.967143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:36:59.968069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:36:59.975409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:59.975892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:59.976322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:36:59.977053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:36:59.977504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:36:59.977931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:00.011713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:00.012365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:00.019493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:00.020070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:00.020607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:00.021372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:00.021897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:00.022380 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:00.156941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:00.164877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-11aa1c47-1a05-435e-825c-4e2486d7f05f tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.203441 Aug 09 12:37:00.165545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 636/1279] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:36:59 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:00.186412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:00.195041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7fe8282-c2b1-4915-ad82-119847617610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.187888 Aug 09 12:37:00.195610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 644/1280] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:00 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:01.189337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:01.190099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:01.200035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:01.200849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:01.201479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:01.202519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:01.203205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:01.203942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:01.215235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:01.215806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:01.223201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:01.223694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:01.224121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:01.224834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:01.225280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:01.225731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:01.229906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:01.652722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:01.661352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4f1e5d9f-bc2f-4203-b92e-ba79ffb3dfab tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.478560 Aug 09 12:37:01.661938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 637/1281] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:01 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:01.676439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:01.684421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-889336db-8ecc-4914-898b-bcaa59f7d782 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.473130 Aug 09 12:37:01.684976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 645/1282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:01 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:02.685414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:02.686053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:02.695913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:02.696658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:02.697291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:02.698312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:02.698760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:02.699167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:02.706197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:02.706994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:02.714593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:02.715076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:02.715505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:02.716198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:02.716670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:02.717095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:02.916259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:02.920947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:02.924090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3e8e52a-84fb-44e5-a033-d78e91005c08 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.245256 Aug 09 12:37:02.924705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 638/1283] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:02 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:02.928939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4c0a78e-29a3-4ca8-b128-d0f8e995796f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.226602 Aug 09 12:37:02.929663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 646/1284] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:02 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:03.945084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:03.945727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:03.950088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:03.950679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:03.952600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:03.953086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:03.953517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:03.954763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:03.955221 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:03.955641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:03.957183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:03.957670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:03.958081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:03.958803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:03.959254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:03.959667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:04.153511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:04.157074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:04.161739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a08c1f53-5a32-4dc1-9ded-eb5741f93278 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.220542 Aug 09 12:37:04.162287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 639/1285] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:03 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:04.165042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72648571-9151-4f72-ae05-350c76a89d92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.218845 Aug 09 12:37:04.165803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 647/1286] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:03 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:05.186558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:05.187562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:05.189448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:05.190060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:05.195169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:05.195602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:05.196029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:05.196731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:05.196901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:05.197210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:05.197377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:05.197626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:05.197793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:05.198324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:05.198774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:05.199202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:05.398705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:05.402818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:05.406754 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a4dab7b3-9a6c-4d2d-a31e-a15892cc4f29 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.226674 Aug 09 12:37:05.407641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 640/1287] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:05 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:05.411006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-11578dea-902f-41ec-9aa5-02809201fb50 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.227502 Aug 09 12:37:05.411544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 648/1288] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:05 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:05.513881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:37:05.514229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:37:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:37:06.427549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:06.428241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:06.432756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:06.433932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:06.435787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:06.436162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:06.436638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:06.437349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:06.438092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:06.438313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:06.445470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:06.446823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:06.447471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:06.448410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:06.449078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:06.450355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:06.663728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:06.670658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:06.680100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-484490f8-03f1-4bc4-b1b6-df597bbcd40e tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.256400 Aug 09 12:37:06.682930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 641/1289] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:06 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:06.685842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16f8be4f-99b9-4fc5-bff4-7bdfbd6739c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1459 microversion: 2.1 time: 0.258494 Aug 09 12:37:06.686680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 649/1290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:06 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1459 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:06.874581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-5e41aec3-2cbb-461f-8671-3c4f60bfa3e8 req-6bc031d0-4e54-4103-8c9d-b54dd3164017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091", "name": "network-vif-deleted", "tag": "360d1d5b-897e-40a1-93d7-e97dbff856e7"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:37:06.893845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-5e41aec3-2cbb-461f-8671-3c4f60bfa3e8 req-6bc031d0-4e54-4103-8c9d-b54dd3164017 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:06.894322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-5e41aec3-2cbb-461f-8671-3c4f60bfa3e8 req-6bc031d0-4e54-4103-8c9d-b54dd3164017 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:06.894958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-5e41aec3-2cbb-461f-8671-3c4f60bfa3e8 req-6bc031d0-4e54-4103-8c9d-b54dd3164017 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:06.909768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-5e41aec3-2cbb-461f-8671-3c4f60bfa3e8 req-6bc031d0-4e54-4103-8c9d-b54dd3164017 service nova] Creating event network-vif-deleted:360d1d5b-897e-40a1-93d7-e97dbff856e7 for instance f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 on hv-cinder-85236 Aug 09 12:37:06.916075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-5e41aec3-2cbb-461f-8671-3c4f60bfa3e8 req-6bc031d0-4e54-4103-8c9d-b54dd3164017 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045389 Aug 09 12:37:06.919779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 642/1291] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:37:07.704702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:07.705290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:07.708546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:07.709244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:07.711438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:07.711910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:07.712578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:07.713291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:07.713732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:07.714386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:07.715671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:07.716300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:07.716969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:07.718035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:07.718560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:07.718991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:07.814694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:07.822985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b85858ac-cbfa-4403-9776-a9b6509ca158 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.119490 Aug 09 12:37:07.823559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 643/1292] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:07 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:07.924735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:07.932718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-51df12c5-3f87-4533-bf18-724369587b47 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.232346 Aug 09 12:37:07.933396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 650/1293] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:07 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:08.067818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:08.068420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:08.069548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-e85c39c8-a6f1-4a25-aad0-a3ede8b99266 req-23b76600-6ad6-47fa-a8d1-9f0d71dd8adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a368964e-2b12-4ec7-a757-4cf2796910ab", "tag": "547a0884-98cf-4ddd-b43b-9c8ffe94c31a"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:37:08.074647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.075127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.075547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:08.076263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.076739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.077159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:08.079606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e85c39c8-a6f1-4a25-aad0-a3ede8b99266 req-23b76600-6ad6-47fa-a8d1-9f0d71dd8adf service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.080163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e85c39c8-a6f1-4a25-aad0-a3ede8b99266 req-23b76600-6ad6-47fa-a8d1-9f0d71dd8adf service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.080691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-e85c39c8-a6f1-4a25-aad0-a3ede8b99266 req-23b76600-6ad6-47fa-a8d1-9f0d71dd8adf service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:08.092897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-e85c39c8-a6f1-4a25-aad0-a3ede8b99266 req-23b76600-6ad6-47fa-a8d1-9f0d71dd8adf service nova] Creating event network-changed:547a0884-98cf-4ddd-b43b-9c8ffe94c31a for instance a368964e-2b12-4ec7-a757-4cf2796910ab on hv-cinder-85236 Aug 09 12:37:08.098519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-e85c39c8-a6f1-4a25-aad0-a3ede8b99266 req-23b76600-6ad6-47fa-a8d1-9f0d71dd8adf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032720 Aug 09 12:37:08.099244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 651/1294] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:37:08.106867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:37:08.195672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-958e63f5-ffbd-481b-93f8-16f93e7a8b1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "DELETE /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 204 len: 0 microversion: 2.1 time: 0.132143 Aug 09 12:37:08.196475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 644/1295] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:37:08 2022] DELETE /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:37:08.206083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:08.206777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:08.212981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.213459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.213892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:08.214585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.215032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.215451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:08.357134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:08.365827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08f249f8-ba9f-4411-bbd3-b5b6c19dec82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.164271 Aug 09 12:37:08.366408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 652/1296] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:08 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:08.843900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:08.844570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:08.851107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.851593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.852023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:08.852734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.853182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.853598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:08.917665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:08.926037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-67ae8fcb-4b2a-4ca8-8b28-fee9164f7496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.086447 Aug 09 12:37:08.926713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 645/1297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:08 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:08.954292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:08.954912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:08.962464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.963314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.963831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:08.964586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:08.965042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:08.965452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:09.098129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:09.106069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f7be4ed8-8f33-49b4-a27c-e069a45ecce0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.155878 Aug 09 12:37:09.106626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 653/1298] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:08 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:09.391565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:09.392127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:09.398508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:09.399020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:09.399475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:09.400199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:09.400694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:09.401138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:09.539355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:09.546976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-52096b05-8ca7-4130-990b-657357eeb9ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.162040 Aug 09 12:37:09.547629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 646/1299] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:09.951025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:09.951908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:09.963194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:09.964143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:09.964740 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:09.965960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:09.966715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:09.967426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:10.035655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:10.043448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c267702-a33f-4a68-a190-9a326a0b1d8d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099128 Aug 09 12:37:10.044017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 654/1300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:09 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:10.124525 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:37:10.124741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:37:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:37:10.135173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:10.135793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:10.144269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:10.145744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:10.146168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:10.147019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:10.147691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:10.148114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:10.295241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:10.303164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0397978b-0060-46fd-a69c-c7d9cb5b0fad tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.179291 Aug 09 12:37:10.304053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 647/1301] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:10 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:10.573409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:10.574430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:10.584679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:10.585488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:10.586210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:10.587349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:10.588107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:10.588859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:10.734733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:10.747121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff4d6bc7-9c91-4662-9e31-1129b0241043 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.179932 Aug 09 12:37:10.747929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 655/1302] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:10 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:11.068825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:11.069814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:11.079597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:11.080075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:11.080536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:11.081218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:11.081665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:11.082080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:11.154108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:11.161905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1259f441-a0eb-491f-93e7-286eb6074d35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099910 Aug 09 12:37:11.162466 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 648/1303] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:11 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:11.328044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:11.329106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:11.339878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:11.340737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:11.341470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:11.342674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:11.343426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:11.344129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:11.488273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:11.496223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d02f7d54-4a9d-4128-b113-eac8b6521ad7 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.174588 Aug 09 12:37:11.497077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 656/1304] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:11 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:11.740514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-0edacdbd-8d47-4507-a596-473da281f1d2 req-62b2e976-8b1d-4c11-a28d-b2ee05e19114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561b5a09-d3cd-46ea-80fc-ca65bcab62e2", "name": "network-vif-plugged", "status": "completed", "tag": "b036aa49-6ed0-484d-861d-6cfafcb9efe2"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:37:11.750694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-0edacdbd-8d47-4507-a596-473da281f1d2 req-62b2e976-8b1d-4c11-a28d-b2ee05e19114 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:11.751173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-0edacdbd-8d47-4507-a596-473da281f1d2 req-62b2e976-8b1d-4c11-a28d-b2ee05e19114 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:11.751661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-0edacdbd-8d47-4507-a596-473da281f1d2 req-62b2e976-8b1d-4c11-a28d-b2ee05e19114 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:11.763894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-0edacdbd-8d47-4507-a596-473da281f1d2 req-62b2e976-8b1d-4c11-a28d-b2ee05e19114 service nova] Creating event network-vif-plugged:b036aa49-6ed0-484d-861d-6cfafcb9efe2 for instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 on hv-cinder-85236 Aug 09 12:37:11.771152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-0edacdbd-8d47-4507-a596-473da281f1d2 req-62b2e976-8b1d-4c11-a28d-b2ee05e19114 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Aug 09 12:37:11.772340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 649/1305] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:37:11.774868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:11.775473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:11.781469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:11.782336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:11.783065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:11.783762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:11.784421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:11.784830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:11.988990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:11.997556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e345071a-1be5-41e1-9eb1-431be1707cfb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1567 microversion: 2.1 time: 0.226898 Aug 09 12:37:11.998258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 657/1306] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:11 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:12.187250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:12.188434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:12.195142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:12.195626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:12.196059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:12.196808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:12.197264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:12.197688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:12.278702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:12.286854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-087d1200-ee29-4fc5-98c7-8abd734c067c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.106365 Aug 09 12:37:12.287428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 650/1307] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:12 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:12.518241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:12.518825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:12.525560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:12.526108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:12.526479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:12.527173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:12.527696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:12.528125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:12.665838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:12.677428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1635437b-bd5d-451a-a53c-f511d35f2958 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.162958 Aug 09 12:37:12.678300 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 658/1308] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:12 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:13.020568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:13.021329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:13.027809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:13.028301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:13.028760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:13.029446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:13.029887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:13.030313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:13.307781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:13.308501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:13.315132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:13.315617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:13.316043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:13.316771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:13.317219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:13.317634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:13.420081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:13.428164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e291a9d7-9243-413a-8a6d-209c46ed669e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.124807 Aug 09 12:37:13.428745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 659/1309] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:13 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:13.529226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:13.533254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:13.538142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f39c4887-9346-4127-8f0a-5064d655e73e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1449 microversion: 2.1 time: 0.521819 Aug 09 12:37:13.538706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 651/1310] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:13 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1449 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:13.702154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:13.702755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:13.711405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:13.712231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:13.712701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:13.713409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:13.713855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:13.714502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:13.752199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-6fd8690f-322a-4332-b6ac-a37071d9b89d req-1967e42c-959b-401d-98a6-6823fa4d7d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a368964e-2b12-4ec7-a757-4cf2796910ab", "name": "network-vif-deleted", "tag": "547a0884-98cf-4ddd-b43b-9c8ffe94c31a"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:37:13.763912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-6fd8690f-322a-4332-b6ac-a37071d9b89d req-1967e42c-959b-401d-98a6-6823fa4d7d2d service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:13.764905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-6fd8690f-322a-4332-b6ac-a37071d9b89d req-1967e42c-959b-401d-98a6-6823fa4d7d2d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:13.765512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-6fd8690f-322a-4332-b6ac-a37071d9b89d req-1967e42c-959b-401d-98a6-6823fa4d7d2d service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:13.778797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-6fd8690f-322a-4332-b6ac-a37071d9b89d req-1967e42c-959b-401d-98a6-6823fa4d7d2d service nova] Creating event network-vif-deleted:547a0884-98cf-4ddd-b43b-9c8ffe94c31a for instance a368964e-2b12-4ec7-a757-4cf2796910ab on hv-cinder-85236 Aug 09 12:37:13.787981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-6fd8690f-322a-4332-b6ac-a37071d9b89d req-1967e42c-959b-401d-98a6-6823fa4d7d2d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042540 Aug 09 12:37:13.789867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 652/1311] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:37:13.855820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:13.864549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-15607ca7-c406-4a89-bf01-57920490b7a0 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1314 microversion: 2.1 time: 0.165918 Aug 09 12:37:13.865219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 660/1312] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:13 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:14.450925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:14.451629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:14.458337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:14.458946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:14.459378 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:14.460092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:14.460574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:14.460994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:14.530139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:14.538318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-203ee654-da1b-49d1-8424-a5e3d449edd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092206 Aug 09 12:37:14.538922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 653/1313] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:14 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:14.559224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:14.559830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:14.566612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:14.567100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:14.567526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:14.568214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:14.568697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:14.569118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:14.631142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:14.639219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d3f7a3cf-4e5a-4e4e-a8f6-e3554953fd67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.083920 Aug 09 12:37:14.639794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 661/1314] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:14 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:14.889866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:14.891032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:14.902175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:14.902974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:14.903693 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:14.905067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:14.905829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:14.906534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:15.048162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:15.060630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9e6b7338-1d0e-4d37-a760-cfb06b598827 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1463 microversion: 2.1 time: 0.176818 Aug 09 12:37:15.061472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 654/1315] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:14 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:15.563886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:15.565205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:15.575967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:15.576831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:15.577555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:15.578680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:15.579426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:15.580352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:15.598520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:15.647206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:15.654940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-531d9d09-c48c-4350-8d1e-930f222d62d1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097559 Aug 09 12:37:15.657377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 662/1316] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:15 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:15.660942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:15.661578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:15.668841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:15.669365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:15.669796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:15.670569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:15.671020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:15.671441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:15.738564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:15.748339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e84f9d85-db65-4670-8e17-8d2a99643804 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091557 Aug 09 12:37:15.749446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 655/1317] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:15 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:16.682440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:16.683552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:16.692687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:16.693170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:16.693604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:16.694302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:16.694753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:16.695174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:16.763775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:16.771250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:16.771868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:16.772108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-916eccb8-a4e6-41a5-a001-9c0be68f2537 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096445 Aug 09 12:37:16.772699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 663/1318] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:16 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:16.778369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:16.779018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:16.779447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:16.780122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:16.780794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:16.781210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:16.843302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:16.851243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-79ba4154-dcd0-4fd1-b866-18e8a9ea5f1d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.084826 Aug 09 12:37:16.851805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 656/1319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:16 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:17.796119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:17.796732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:17.804191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:17.804707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:17.805145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:17.805865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:17.806319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:17.806741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:17.871408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:17.871888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:17.872621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:17.879794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a43d054d-a73f-4ff0-938b-969ee81ba310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089178 Aug 09 12:37:17.879966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:17.880268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:17.889353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 664/1320] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:17 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:17.890124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:17.890124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:17.890124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:17.890124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:17.946454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:17.953967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6cd8993a-262c-4b89-8e6a-8a3eb8968729 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.085955 Aug 09 12:37:17.954530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 657/1321] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:17 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:18.907222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:18.908241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:18.915436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:18.915918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:18.916349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:18.917087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:18.917533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:18.917954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:18.975088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:18.975755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:18.980023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:18.982845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:18.983423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:18.983893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:18.984653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:18.985096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:18.985534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:18.988238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74abaf49-e7a0-4ba0-9415-457612aba877 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.088761 Aug 09 12:37:18.988878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 665/1322] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:18 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:19.047540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:19.056731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-471ca116-9593-44c0-afd4-41f5910b76ca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.085960 Aug 09 12:37:19.057279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 658/1323] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:18 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:20.013714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:20.014567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:20.022931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:20.023427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:20.023853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:20.024583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:20.025037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:20.025447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:20.079602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:20.080481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:20.088539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:20.089120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:20.089637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:20.090413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:20.090866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:20.091288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:20.097246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:20.105122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a14171a3-0ca9-4974-8dbb-4fb93984e0b1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098220 Aug 09 12:37:20.105692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 666/1324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:20 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:20.157375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:20.165220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-da5bc531-7f3f-4598-b071-6daa759190a5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090848 Aug 09 12:37:20.166024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 659/1325] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:20 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:21.129677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:21.130325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:21.136429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:21.136918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:21.137344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:21.138027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:21.138470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:21.138886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:21.186625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:21.187223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:21.194863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:21.195337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:21.195740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:21.196499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:21.196932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:21.197346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:21.206571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:21.214374 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b3d6d073-7a24-4c19-a83a-e4a09f375146 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090729 Aug 09 12:37:21.214962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 667/1326] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:21 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:21.258364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:21.265984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-807c644b-4c68-42df-96fa-72e0460bdab7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.083411 Aug 09 12:37:21.266512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 660/1327] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:21 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:22.239311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:22.240057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:22.248997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:22.249653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:22.250589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:22.251511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:22.252118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:22.252803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:22.286199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:22.286848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:22.293723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:22.294208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:22.294647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:22.295352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:22.295842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:22.296267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:22.318168 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:22.326029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-23bd145e-b03f-4903-a175-416fa2a2daf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092918 Aug 09 12:37:22.326807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 668/1328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:22 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:22.360801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:22.368575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-44fa350b-31f2-4900-a961-03c487f8004b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086489 Aug 09 12:37:22.369119 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 661/1329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:22 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:23.351196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:23.351965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:23.360749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:23.361384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:23.361951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:23.363142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:23.363738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:23.364298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:23.389703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:23.390615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:23.400885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:23.401534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:23.402127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:23.403096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:23.403688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:23.404302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:23.436537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:23.444356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7f1e4f17-be80-4b21-a7c4-e26fe1b0958b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099401 Aug 09 12:37:23.444950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 669/1330] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:23 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:23.471598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:23.479648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b18479db-e3e3-43f0-8842-6c7a545f711e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094094 Aug 09 12:37:23.480224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 662/1331] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:23 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:24.471308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:24.472307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:24.483410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:24.484204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:24.484983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:24.486133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:24.486894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:24.487636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:24.501186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:24.502134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:24.509053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:24.509534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:24.509960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:24.510649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:24.511099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:24.511507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:24.553216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:24.561059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ef60efcd-440e-40ee-af87-2fe19a09c194 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096758 Aug 09 12:37:24.561615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 670/1332] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:24 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:24.582584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:24.590296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3375bfe3-cf52-49d1-93c7-54b0e46516d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093759 Aug 09 12:37:24.590858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 663/1333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:24 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:25.585715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:25.586661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:25.597503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:25.598519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:25.599049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:25.600072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:25.600644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:25.601065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:25.611666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:25.612274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:25.619018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:25.619497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:25.619926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:25.620644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:25.621254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:25.621645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:25.677268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:25.684984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-21c989a7-828f-47f7-bd9c-d80b768194f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.105813 Aug 09 12:37:25.693990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 671/1334] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:25 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:25.696718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:25.704335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5f76df66-3343-4264-ab4b-79f2293361cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096675 Aug 09 12:37:25.704928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 664/1335] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:25 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:26.710175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:26.711320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:26.722127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:26.722985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:26.723753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:26.724949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:26.728206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:26.728206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:26.730437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:26.731071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:26.737350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:26.737836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:26.738274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:26.738967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:26.739415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:26.740114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:26.803724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:26.811443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-69e610d4-83cc-481e-ab24-79ffc0fe2f89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.107819 Aug 09 12:37:26.811988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 672/1336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:26 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:26.820114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:26.831225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ac53636-6659-4230-9e3b-fb98359b9bc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.107985 Aug 09 12:37:26.831914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 665/1337] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:26 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:27.838758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:27.839793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:27.849270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:27.849816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:27.850285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:27.851018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:27.851476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:27.851921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:27.852916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:27.853526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:27.860488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:27.860980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:27.861407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:27.862088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:27.862527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:27.862940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:27.926571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:27.934703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8f30dbe4-3e5d-4293-bee4-2e356531fca9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.101640 Aug 09 12:37:27.935275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 673/1338] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:27 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:27.942479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:27.950444 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7fbca8e1-2ce6-4fdb-8348-ea02c1647e8a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101591 Aug 09 12:37:27.951017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 666/1339] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:27 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:28.960541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:28.961540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:28.966992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=62 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:28.972937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:28.973730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:28.974333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:28.974798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:28.974911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:28.975535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:28.975984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:28.976411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:28.977418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:28.982952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:28.983441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:28.983873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:28.984650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:28.985109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:28.985563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:29.046581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:29.054395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a715f58e-dd86-4c51-b35e-53c5f6846a60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100974 Aug 09 12:37:29.054974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 674/1340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:28 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:29.061792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:29.069687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8ebf6e1b-9579-4d9c-9834-822623cf680b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101840 Aug 09 12:37:29.070278 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 667/1341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:28 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:30.080099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:30.081025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:30.089660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:30.090142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:30.090580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:30.091205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:30.091679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:30.091679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:30.091882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:30.092129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:30.098466 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:30.098940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:30.099365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:30.100048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:30.100532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:30.100952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:30.165517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:30.173596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2de03b0-9d9a-4db2-9c3e-2700007e260b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100282 Aug 09 12:37:30.174165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 675/1342] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:30 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:30.181089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:30.189652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d800faa5-00c4-427c-b425-644083995e7c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102144 Aug 09 12:37:30.190451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 668/1343] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:30 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:31.200062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:31.201005 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:31.213163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:31.213971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:31.214697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:31.215141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:31.215846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:31.216145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:31.216636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:31.217329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:31.226446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:31.226935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:31.227382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:31.228085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:31.228573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:31.228999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:31.233074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:31.306813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:31.309952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:31.318934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-541c541c-84e3-4c63-9b97-abf31b3bff93 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.125865 Aug 09 12:37:31.319837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 676/1344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:31 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:31.322054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-98ccb470-0101-46ca-9bce-413438a3ff34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.113031 Aug 09 12:37:31.322918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 669/1345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:31 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:32.349791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:32.350837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:32.351417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:32.352027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:32.357924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:32.358400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:32.358796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:32.358968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:32.359263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:32.359488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:32.359696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:32.359942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:32.360357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:32.360487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:32.360851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:32.361274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:32.439519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:32.447435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c47587a7-e4d7-4ca7-837d-c14f8a0ef0e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.104030 Aug 09 12:37:32.448016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 677/1346] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:32 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:32.456269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:32.464010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-660516c9-a2b7-4b54-93d8-8c46a70cbe55 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.118877 Aug 09 12:37:32.464612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 670/1347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:32 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:33.471473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:33.472453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:33.480880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:33.481367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:33.481806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:33.482496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:33.482951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:33.483375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:33.484631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:33.485245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:33.491605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:33.492107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:33.492595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:33.493292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:33.493744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:33.494163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:33.567965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:33.569148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:33.575986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd1e6dca-6dd2-4457-9ee0-a0b92647a811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.111174 Aug 09 12:37:33.576556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 678/1348] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:33 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:33.576732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c82677f-949f-4539-b015-e81beec6c8cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095852 Aug 09 12:37:33.577257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 671/1349] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:33 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:34.601702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:34.602421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:34.602788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:34.602889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:34.609137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:34.609363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:34.609587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:34.609721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:34.610040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:34.610215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:34.610700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:34.611088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:34.611243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:34.611540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:34.611715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:34.611960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:34.616099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:34.682109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:34.690047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-18a66fbb-e29b-42de-b5e2-be1ca7708310 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095615 Aug 09 12:37:34.690625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 672/1350] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:34 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:34.701423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:34.712073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-99d4fb50-124f-4b78-8c33-3944ebda7695 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.117445 Aug 09 12:37:34.712826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 679/1351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:34 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:35.712332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:35.713096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:35.719997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:35.720508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:35.720944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:35.721634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:35.722084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:35.722508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:35.737190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:35.737760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:35.744288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:35.744805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:35.745306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:35.746152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:35.746612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:35.747042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:35.786890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:35.795655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c2b0c9b7-8286-4334-82c5-21f8e7b0acd5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087873 Aug 09 12:37:35.796346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 673/1352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:35 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:35.812547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:35.820690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-21f47b38-3307-4295-8432-5f4d499cefed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087569 Aug 09 12:37:35.821222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 680/1353] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:35 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:36.820875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:36.821819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:36.829920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:36.830401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:36.830833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:36.831552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:36.832005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:36.832431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:36.842214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:36.842824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:36.849572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:36.850055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:36.850489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:36.851175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:36.851625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:36.852046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:36.905430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:36.913313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-42d7a014-8a15-4eec-8878-bb4fc718a3a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098964 Aug 09 12:37:36.913892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 674/1354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:36 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:36.924536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:36.936838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d560a44-cf87-40f9-babd-d7bd0545f81e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098701 Aug 09 12:37:36.937636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 681/1355] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:36 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:37.936888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:37.937498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:37.945158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:37.945699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:37.946183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:37.946953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:37.947450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:37.947933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:37.961641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:37.962241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:37.968430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:37.968929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:37.969352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:37.970037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:37.970483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:37.971133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:38.024704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:38.032664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6a420bc-b9d6-4b52-9977-cdf968d7281b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.101674 Aug 09 12:37:38.033274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 675/1356] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:37 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:38.044474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:38.052403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80fe7d4f-7cde-4187-bd38-0fc92b513219 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094825 Aug 09 12:37:38.052973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 682/1357] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:37 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:39.057676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:39.058856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:39.069684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:39.070471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:39.071184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:39.072344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:39.073092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:39.073779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:39.076254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:39.076910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:39.083799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:39.084285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:39.084800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:39.085502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:39.085957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:39.086386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:39.145822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:39.153889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7b5bed29-78bf-433b-9cc6-7c44113c5da0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102678 Aug 09 12:37:39.154474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 676/1358] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:39 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:39.161597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:39.170355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6dd85b9d-0190-46ce-8940-187400888aff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099646 Aug 09 12:37:39.170918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 683/1359] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:39 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:40.179580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:40.180537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:40.188888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:40.189389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:40.189821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:40.190509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:40.190874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:40.191339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:40.191339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:40.191558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:40.198136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:40.198617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:40.199052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:40.199842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:40.200272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:40.200756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:40.277165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:40.279291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:40.285472 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6b9473ff-3809-4456-b24c-33398709ff18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.112895 Aug 09 12:37:40.286045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 677/1360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:40 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:40.287142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f18fea19-0112-4477-bb9d-93571242464d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100060 Aug 09 12:37:40.287703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 684/1361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:40 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:41.307023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:41.307659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:41.308691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:41.309682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:41.315085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:41.315568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:41.316333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:41.316681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:41.316857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:41.317279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:41.317412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:41.317821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:41.318030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:41.318239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:41.318485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:41.318905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:41.400212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:41.401751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:41.408840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81752596-d235-4754-ab30-72768094d795 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.103968 Aug 09 12:37:41.409365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4f13b36f-a2bd-43dd-9092-ff26c03962f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.106329 Aug 09 12:37:41.409522 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 685/1362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:41 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:41.410107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 678/1363] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:41 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:42.433742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:42.434724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:42.435278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:42.435377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:42.441563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:42.441763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:42.442046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:42.442224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:42.442428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:42.442540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:42.443144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:42.443313 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:42.443590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:42.443747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:42.444002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:42.444162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:42.527165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:42.529285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:42.535058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-afb03d76-75ce-45d7-b1a7-903e59553cf2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.107878 Aug 09 12:37:42.535892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 679/1364] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:42 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:42.537080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3866a900-9e23-4201-ab8c-a7112a867559 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.109900 Aug 09 12:37:42.537644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 686/1365] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:42 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:43.560993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:43.561956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:43.562170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:43.563137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:43.573241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:43.573551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:43.574140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:43.574655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:43.574901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:43.575491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:43.575815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:43.576261 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:43.576494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:43.576874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:43.577113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:43.577289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:43.661055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:43.663473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:43.669009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-309a9884-5847-44eb-8ee2-90d8cdf98ee6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.114797 Aug 09 12:37:43.669566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 680/1366] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:43 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:43.672034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4602f802-c85d-48f4-adf0-74078d6d75ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.116817 Aug 09 12:37:43.672648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 687/1367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:43 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:44.692973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:44.693749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:44.694222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:44.694362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:44.702615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:44.702858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:44.703222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:44.703425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:44.703766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:44.703980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:44.704712 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:44.704892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:44.705241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:44.705432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:44.705758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:44.705948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:44.799446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:44.801247 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:44.807362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1f805275-8450-4f24-9b70-8f311e90a0df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.119221 Aug 09 12:37:44.807949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 681/1368] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:44 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:44.809043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-020e071d-dc9f-40a8-bdd8-e70620ac3c0d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.120295 Aug 09 12:37:44.809610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 688/1369] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:44 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:45.829414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:45.830024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:45.830495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:45.830603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:45.836953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:45.837150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:45.837441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:45.837609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:45.837915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:45.838084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:45.838618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:45.838771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:45.839072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:45.839238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:45.839491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:45.839640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:45.909411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:45.917052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e9c30c81-41d4-416a-bc91-859d9759776d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091757 Aug 09 12:37:45.917621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 689/1370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:45 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:45.924692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:45.932327 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f4db62e9-eb01-4bd5-b65e-bde9bc6db03f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.107045 Aug 09 12:37:45.932910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 682/1371] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:45 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:46.937574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:46.938202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:46.945177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:46.945660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:46.946094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:46.946825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:46.947278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:46.947851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:46.953355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:46.953959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:46.960630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:46.961107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:46.961538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:46.962224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:46.962670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:46.963087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:47.012270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:47.020564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd8b444a-8912-4668-926a-6369a04cb029 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087046 Aug 09 12:37:47.021205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 690/1372] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:46 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:47.042387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:47.053145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e629ab1-dace-40d8-b589-830965b4bcf1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103967 Aug 09 12:37:47.053857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 683/1373] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:46 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:48.047348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:48.047942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:48.057164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:48.057851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:48.058456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:48.059461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:48.060033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:48.060645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:48.074854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:48.075698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:48.083078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:48.083560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:48.083989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:48.084722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:48.085170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:48.085587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:48.133988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:48.142126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f08d32dc-d2d1-4ede-a1f3-ed9d26290663 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101061 Aug 09 12:37:48.142731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 691/1374] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:48 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:48.153851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:48.164822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-179e2b37-ff06-4e44-93a9-bbcf0ea6d802 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093841 Aug 09 12:37:48.165688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 684/1375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:48 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:49.167386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:49.168291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:49.179127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:49.179917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:49.180691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:49.181988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:49.182744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:49.183440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:49.188736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:49.189340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:49.196109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:49.196625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:49.197074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:49.197763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:49.198205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:49.198593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:49.258408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:49.266220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4a1ff379-6511-4a46-b424-4867b61ae3cd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.105392 Aug 09 12:37:49.267045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 692/1376] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:49 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:49.277803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:49.281408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:49.286050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6aa63a67-d247-4373-9b59-9b5dc274e523 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102633 Aug 09 12:37:49.286594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 685/1377] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:49 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:50.287685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:50.288285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:50.295224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:50.296045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:50.296221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:50.296952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:50.297399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:50.297845 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:50.307878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:50.308570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:50.316407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:50.317016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:50.317494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:50.318188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:50.318635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:50.319054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:50.372597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:50.381080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c9a7b311-fc16-477e-a1f7-d6db8630122f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097379 Aug 09 12:37:50.381636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 693/1378] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:50 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:50.400549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:50.411830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-97f0531a-7639-4271-8109-5daab898a0be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.108329 Aug 09 12:37:50.412582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 686/1379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:50 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:51.406076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:51.406789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:51.414559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:51.415119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:51.415620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:51.416441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:51.417000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:51.417493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:51.436392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:51.437042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:51.443695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:51.444482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:51.444897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:51.445589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:51.446033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:51.446451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:51.491772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:51.500128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebbbb8f5-e621-4f38-a1f7-39e8129190ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100457 Aug 09 12:37:51.501097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 694/1380] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:51 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:51.510940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:51.519718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cc78c14b-b47f-48e2-baaf-e663b63e7690 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.088071 Aug 09 12:37:51.520294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 687/1381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:51 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:52.525502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:52.526475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:52.537920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:52.538707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:52.539416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:52.540586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:52.541338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:52.542033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:52.544826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:52.545771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:52.552445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:52.552942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:52.553368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:52.554052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:52.554497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:52.554911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:52.606655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:52.610307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:52.615051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-58d36cf6-dd74-4206-9bb9-f0da51102304 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096104 Aug 09 12:37:52.615893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 695/1382] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:52 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:52.639614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:52.647637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-86428dce-9e1f-48b6-9c90-e94d0a63341d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.109368 Aug 09 12:37:52.648197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 688/1383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:52 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:53.641718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:53.642663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:53.653891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:53.654678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:53.655577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:53.656341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:53.656816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:53.657234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:53.668475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:53.669107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:53.676488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:53.676973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:53.677400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:53.678088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:53.678537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:53.678949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:53.722518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:53.730524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f759b55-8133-4f6c-8cc5-28f74729fd25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095572 Aug 09 12:37:53.731298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 696/1384] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:53 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:53.748567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:53.757429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1a301908-ea87-4544-9d32-647ac3ae34f4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092864 Aug 09 12:37:53.757995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 689/1385] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:53 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:54.754735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:54.755406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:54.763826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:54.764509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:54.765009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:54.765821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:54.766297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:54.766749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:54.842950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:54.851891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d33364b-1b0c-417e-9a1c-b499ff7d6b80 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.103432 Aug 09 12:37:54.852488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 697/1386] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:54 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:54.930373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:54.930978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:54.937142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:54.937617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:54.938042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:54.938721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:54.939165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:54.939579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:55.007404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:55.018112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f48eb5ca-efa7-4b89-b0f4-a72a95036cf3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.243689 Aug 09 12:37:55.018703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 690/1387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:54 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:55.877298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:55.877958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:55.885866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:55.886420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:55.886927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:55.887736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:55.888568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:55.888808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:55.954843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:55.962760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4319cde-f60f-4617-be32-6bcf098a4996 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092206 Aug 09 12:37:55.963320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 698/1388] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:55 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:56.043291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:56.044169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:56.054531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:56.055325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:56.056039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:56.057249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:56.057970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:56.058737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:56.134639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:56.146032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1dab0796-e9d7-423f-a8fb-4eb85fb63f0e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.109145 Aug 09 12:37:56.146900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 691/1389] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:56 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:56.986596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:56.987233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:56.994649 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:56.995143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:56.995576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:56.996272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:56.996772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:56.997196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:57.062285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:57.070112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-89273770-8817-49fd-99df-9c58f0206807 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088990 Aug 09 12:37:57.070651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 699/1390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:56 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:57.174060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:57.174766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:57.182534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:57.183090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:57.183626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:57.184422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:57.184985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:57.185473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:57.248743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:57.257344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aaf71205-c7e1-492e-8ee4-efe4f68b083e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089485 Aug 09 12:37:57.257925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 692/1391] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:57 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:58.094300 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:58.094868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:58.101597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:58.102073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:58.102498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:58.103179 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:58.103625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:58.104043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:58.175739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:58.187032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db4604a7-6c66-44c6-9d65-aae8ab22e03c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098935 Aug 09 12:37:58.187685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 700/1392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:58 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:58.282231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:58.282968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:58.291291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:58.291888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:58.292428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:58.293306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:58.293868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:58.294393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:58.364994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:58.372638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-09901673-0eb7-4ed1-b2b5-e862168bfce3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096656 Aug 09 12:37:58.373214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 693/1393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:58 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:59.212825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:59.213664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:59.217516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:59.227216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:59.227966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:59.229005 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:59.230137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:59.230882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:59.231575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:59.294708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:59.302435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c16e396e-f483-41e6-8e87-773354588894 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096305 Aug 09 12:37:59.302997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 701/1394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:59 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:37:59.398427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:37:59.399421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:37:59.403268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:59.412356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:59.413212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:59.413940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:59.415091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:37:59.415829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:37:59.416547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:37:59.479201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:37:59.486979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4de88a05-4f5b-4942-a448-95a00de17356 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095127 Aug 09 12:37:59.487535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 694/1395] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:37:59 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:00.327602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:00.329052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:00.339941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:00.340870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:00.341603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:00.342753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:00.343515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:00.344517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:00.411226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:00.422954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e034a5d4-5296-47c9-9612-7511abcd987b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101626 Aug 09 12:38:00.423771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 702/1396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:00 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:00.519664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:00.520734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:00.531869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:00.532355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:00.532815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:00.533570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:00.533995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:00.534414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:00.607125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:00.614941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6bfca02d-c225-494d-b11d-51c4e300fd09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102332 Aug 09 12:38:00.615504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 695/1397] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:00 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:01.448282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:01.449347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:01.457887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:01.458364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:01.458789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:01.459474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:01.459920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:01.460334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:01.523114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:01.531032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db12faa3-a2ef-4302-9aae-5ba29e58ef22 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089371 Aug 09 12:38:01.531604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 703/1398] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:01 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:01.640085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:01.641185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:01.648411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:01.648949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:01.649410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:01.650137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:01.650616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:01.651059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:01.721855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:01.733227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f7a56c1e-1ac2-488e-a16d-9180daee0f92 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099517 Aug 09 12:38:01.733974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 696/1399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:01 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:02.556539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:02.557455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:02.566632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:02.567117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:02.567563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:02.568250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:02.568726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:02.569145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:02.643626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:02.651514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76b6e051-a380-43e1-b8b0-cef2280aba97 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101487 Aug 09 12:38:02.652076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 704/1400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:02 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:02.763450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:02.764148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:02.772571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:02.773129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:02.773627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:02.774437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:02.774958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:02.775449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:02.841737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:02.859531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f333f416-0e7d-4aa0-8a08-1c2513a98f6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102097 Aug 09 12:38:02.860130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 697/1401] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:02 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:03.673363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:03.674001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:03.681269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:03.681781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:03.682217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:03.682919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:03.683373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:03.683793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:03.763069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:03.771535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0dff749e-aa50-4cbe-87a9-611a6686fb1b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102349 Aug 09 12:38:03.772122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 705/1402] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:03 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:38:03.890826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:03.890826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:03.898035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:03.898517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:03.898942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:03.899642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:03.900092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:03.900552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:03.960981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:03.969309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d6e0a86-9523-4e1e-8d7d-f22eb5f37d4b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.085394 Aug 09 12:38:03.969867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 698/1403] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:03 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:04.803662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:04.804685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:04.814846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:04.815332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:04.815765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:04.816477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:04.816949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:04.817366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:04.891798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:04.900042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80fcb793-f028-4c66-b817-ac3bdfe621f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.103834 Aug 09 12:38:04.900638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 706/1404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:04 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:04.992256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:04.992977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:05.001933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:05.002406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:05.002832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:05.003513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:05.003944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:05.004353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:05.067458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:05.075114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b06cd14b-3fb2-4cd2-84a3-7f0fce0eb2b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087787 Aug 09 12:38:05.075685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 699/1405] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:04 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:05.923124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:05.923911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:05.930730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:05.931210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:05.931635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:05.932323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:05.932804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:05.933218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:05.996291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:06.006587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-34cf10c4-ef2c-43a4-bf86-f42bd153db3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088730 Aug 09 12:38:06.007536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 707/1406] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:05 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:06.095883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:06.096569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:06.103463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:06.103947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:06.104410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:06.105110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:06.105563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:06.106017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:06.170204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:06.179330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f64a21dd-adf4-48fe-98a0-1c68aaf73172 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087413 Aug 09 12:38:06.179905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 700/1407] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:06 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:07.034739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:07.035426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:07.043436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:07.044001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:07.044627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:07.045474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:07.046012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:07.046507 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:07.114286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:07.122367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-957b13cc-c1fe-406e-ba87-682431ca8c56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093817 Aug 09 12:38:07.122931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 708/1408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:07 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:07.204170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:07.205390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:07.216105 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:07.216967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:07.217695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:07.218837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:07.219903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:07.220211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:07.294340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:07.302689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a7757e0-457a-4ae7-b253-442e1ff5a57a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.105107 Aug 09 12:38:07.303263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 701/1409] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:07 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:08.146863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:08.147516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:08.154886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:08.155448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:08.155950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:08.156793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:08.157429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:08.157924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:08.227445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:08.235380 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f723062-a190-4e71-a3d9-92769c3603c7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094309 Aug 09 12:38:08.236526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 709/1410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:08 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:08.330414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:08.331021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:08.337898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:08.338409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:08.338842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:08.339586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:08.340034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:08.340485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:08.358597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:08.403781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:08.411856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6a2bdebb-ad7c-45a4-afca-d9465efd8455 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087478 Aug 09 12:38:08.412429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 702/1411] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:08 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:09.269157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:09.270082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:09.281178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:09.281973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:09.282734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:09.283451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:09.283905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:09.284325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:09.359000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:09.367723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-82eb9584-1daf-4a71-bdd2-a19f7965fc95 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.105433 Aug 09 12:38:09.368298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 710/1412] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:09.433031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:09.433669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:09.440508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:09.441012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:09.441438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:09.442122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:09.442563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:09.442979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:09.504031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:09.512193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ded451e2-b44d-45f2-a055-1346cd665a9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.083162 Aug 09 12:38:09.512794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 703/1413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:09 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:10.389764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:10.390472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:10.397831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:10.398315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:10.398749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:10.399449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:10.399896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:10.400316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:10.475920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:10.483923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b86c0807-c552-496a-adac-c49675c808e4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098253 Aug 09 12:38:10.484494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 711/1414] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:10 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:10.533961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:10.534560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:10.541445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:10.541932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:10.542675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:10.543390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:10.543817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:10.544523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:10.629555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:10.638793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3195e9ca-cc88-4d9a-99cf-d145bb58660a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.108612 Aug 09 12:38:10.639546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 704/1415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:10 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:11.506762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:11.507789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:11.515443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:11.515923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:11.516349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:11.517142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:11.517591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:11.518101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:11.538706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:11.589459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:11.597556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1b768a77-7f03-45d9-b004-bc85ea335a90 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095592 Aug 09 12:38:11.598253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 712/1416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:11 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:11.660706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:11.661300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:11.667923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:11.668415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:11.668859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:11.669572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:11.670021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:11.670434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:11.731803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:11.740048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f69420f0-5cc9-462d-8c68-695caf2e1b05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.082894 Aug 09 12:38:11.740721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 705/1417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:11 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:12.622877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:12.623836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:12.635766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:12.636680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:12.637406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:12.638554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:12.639310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:12.640016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:12.702684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:12.710956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a1cb2df3-6a8b-4130-8dd7-75ffd9d87662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094803 Aug 09 12:38:12.711529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 713/1418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:12 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:12.760991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:12.761629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:12.768655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:12.769250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:12.769860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:12.770544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:12.770990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:12.771411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:12.836583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:12.847860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-63b6e376-62dc-4135-9eeb-c94101b06ccb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090533 Aug 09 12:38:12.848784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 706/1419] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:12 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:13.736075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:13.737118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:13.748281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:13.749134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:13.749850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:13.750994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:13.752127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:13.752868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:13.814782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:13.823056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d57e3ab-24d8-4855-822f-434ad0f3c83f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093530 Aug 09 12:38:13.823594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 714/1420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:13 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:13.877965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:13.878483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:13.885547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:13.886030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:13.886565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:13.887349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:13.887799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:13.888214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:13.950365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:13.958325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-63d936c4-3d29-4ef1-88f2-40993a734f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087107 Aug 09 12:38:13.958896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 707/1421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:13 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:14.846826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:14.847890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:14.856176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:14.856828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:14.857375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:14.858238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:14.858810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:14.859321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:14.923243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:14.931564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4492efc3-4e6c-4dd3-a72f-33a55063fc39 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089701 Aug 09 12:38:14.932111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 715/1422] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:14 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:14.981777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:14.982335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:14.989366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:14.989845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:14.990269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:14.990950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:14.991396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:14.991809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:15.068338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:15.076025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60624bb2-30ab-4a87-aef6-60e490d81d86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098235 Aug 09 12:38:15.076652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 708/1423] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:14 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:15.188954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:15.189451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:15.195709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:15.196202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:15.196671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:15.197369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:15.197824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:15.198252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:15.223232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:38:15.305862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b783a761-169a-4ac5-9ba2-16f9fa4415e1 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "DELETE /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 204 len: 0 microversion: 2.1 time: 0.120481 Aug 09 12:38:15.306479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 716/1424] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:38:15 2022] DELETE /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:38:15.317473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:15.318083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:15.324094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:15.324608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:15.325034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:15.325714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:15.326157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:15.326571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:15.459786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:15.467443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d85fb86a-596e-42b0-bc92-1941c45ae5f2 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1469 microversion: 2.1 time: 0.155809 Aug 09 12:38:15.468011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 709/1425] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:15 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:15.957590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:15.958749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:15.969837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:15.970619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:15.971382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:15.972578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:15.973284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:15.973743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:16.038158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:16.049671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c246fdb6-9613-4615-8371-3a05ec2c747d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098926 Aug 09 12:38:16.050376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 717/1426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:15 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:16.097353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:16.098661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:16.105157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:16.105644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:16.106075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:16.106766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:16.107222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:16.107640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:16.177538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:16.189808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1a666815-83f6-4e22-8ce9-f72893d7c034 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096101 Aug 09 12:38:16.190616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 710/1427] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:16 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:16.490202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:16.490900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:16.497099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:16.497587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:16.498023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:16.498983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:16.499212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:16.499635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:16.653928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:16.664135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8b207e9a-61eb-4a98-8ad2-100c2b5a9c48 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1469 microversion: 2.1 time: 0.178414 Aug 09 12:38:16.664775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 718/1428] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:16 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:17.080469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:17.081559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:17.088905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:17.089380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:17.089810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:17.090492 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:17.090936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:17.091356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:17.160210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:17.168412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d749c7a9-76be-4e6a-960e-27d6a9281451 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094557 Aug 09 12:38:17.169027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 711/1429] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:17 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:17.211391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:17.211974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:17.218690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:17.219170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:17.219603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:17.220292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:17.220770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:17.221192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:17.300183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:17.308285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-81a72b9b-ca5e-4f33-bc1b-82f61e892e71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100873 Aug 09 12:38:17.308895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 719/1430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:17 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:17.687676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:17.688349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:17.697970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:17.698366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:17.698758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:17.699462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:17.699944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:17.700366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:17.725900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-9a34d33f-3252-4314-a21d-fed83ed13ff4 req-c2d52ed2-a1a7-4c20-b061-60baeccefaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561b5a09-d3cd-46ea-80fc-ca65bcab62e2", "name": "network-vif-deleted", "tag": "b036aa49-6ed0-484d-861d-6cfafcb9efe2"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:38:17.736205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9a34d33f-3252-4314-a21d-fed83ed13ff4 req-c2d52ed2-a1a7-4c20-b061-60baeccefaf8 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:17.736709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9a34d33f-3252-4314-a21d-fed83ed13ff4 req-c2d52ed2-a1a7-4c20-b061-60baeccefaf8 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:17.737135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-9a34d33f-3252-4314-a21d-fed83ed13ff4 req-c2d52ed2-a1a7-4c20-b061-60baeccefaf8 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:17.749109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-9a34d33f-3252-4314-a21d-fed83ed13ff4 req-c2d52ed2-a1a7-4c20-b061-60baeccefaf8 service nova] Creating event network-vif-deleted:b036aa49-6ed0-484d-861d-6cfafcb9efe2 for instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 on hv-cinder-85236 Aug 09 12:38:17.754717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-9a34d33f-3252-4314-a21d-fed83ed13ff4 req-c2d52ed2-a1a7-4c20-b061-60baeccefaf8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Aug 09 12:38:17.755664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 720/1431] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:38:17.767506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cccf3c12fa446ea861ff20a7fabf48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:17.775355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d0332f37-99fc-482b-969d-a6800f53e591 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 200 len: 1427 microversion: 2.1 time: 0.093826 Aug 09 12:38:17.775932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 712/1432] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:17 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:18.190625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:18.191362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:18.198360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:18.198810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:18.199266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:18.199952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:18.200423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:18.200836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:18.266335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:18.274530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7242851f-2e3b-40d1-9a81-2880bb5871a6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088786 Aug 09 12:38:18.275096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 721/1433] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:18 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:18.330001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:18.330634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:18.337502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:18.337988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:18.338417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:18.339118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:18.339565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:18.340043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:18.405427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:18.413455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bcefc3d7-c804-4a7d-805c-7f27a6ecf120 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087438 Aug 09 12:38:18.414024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 713/1434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:18 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:18.800882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:18.801991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] [instance: 561b5a09-d3cd-46ea-80fc-ca65bcab62e2] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:18.808715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:18.809192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:18.809643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:18.810328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:18.810771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:18.811185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:18.824420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] HTTP exception thrown: Instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 could not be found. Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Request method failure captured: Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 HTTP/1.1 Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lSsPk2H_6gBHUL_5zJWeCK7phCCBKI8lsLIKzP7jui-3xNiM37MedpKQEQboLDShbhfXckjm-kh5FuPyPD1bzNbn47asXUf1G68VyMeVc-mOVMipFXlBwaN30Qc3QPnXhiiHVY7yXiP2q5TfxJzIc0R5BajM7wGgwIe3lmX9aNKr54 Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 8d213e4a7f904eb0b8a21baaeeb1c22a Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesNegativeTest-1607980626 Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:38:18.826078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8d213e4a7f904eb0b8a21baaeeb1c22a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/8d213e4a7f904eb0b8a21baaeeb1c22a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_8d213e4a7f904eb0b8a21baaeeb1c22a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/8d213e4a7f904eb0b8a21baaeeb1c22a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesNegativeTest-1607980626 Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 8d213e4a7f904eb0b8a21baaeeb1c22a Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesNegativeTest-1607980626 Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesNegativeTest-1607980626-project Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 57cccf3c12fa446ea861ff20a7fabf48 Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesNegativeTest-1607980626-project Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 could not be found. Aug 09 12:38:18.827916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '561b5a09-d3cd-46ea-80fc-ca65bcab62e2'} Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 could not be found. Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:38:18.828984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 could not be found. Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 could not be found. Aug 09 12:38:18.830772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:38:18.832309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] Returning 404 to user: Instance 561b5a09-d3cd-46ea-80fc-ca65bcab62e2 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:38:18.832309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db4e9450-8ced-4171-8ec6-7aebd745be13 tempest-VolumesNegativeTest-1607980626 tempest-VolumesNegativeTest-1607980626-project] 10.222.0.60 "GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2" status: 404 len: 111 microversion: 2.1 time: 0.032902 Aug 09 12:38:18.832309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 722/1435] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:18 2022] GET /compute/v2.1/servers/561b5a09-d3cd-46ea-80fc-ca65bcab62e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 12:38:19.294870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:19.295457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:19.301728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:19.302268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:19.302818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:19.303605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:19.304111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:19.304604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:19.370590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:19.378513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-982c7f52-7429-4a97-b8e3-5b41aa8e4095 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087529 Aug 09 12:38:19.379260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 714/1436] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:19 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:19.434241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:19.434904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:19.442299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:19.442778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:19.443207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:19.443928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:19.444344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:19.444802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:19.509451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:19.521116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30df858e-df67-4085-a30d-acc70c1439f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090425 Aug 09 12:38:19.521827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 723/1437] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:19 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:20.404361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:20.405353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:20.415441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:20.415924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:20.416356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:20.417074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:20.417526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:20.417945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:20.482256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:20.494409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a1e6095-6642-4050-91ff-900d7851e8ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097304 Aug 09 12:38:20.495227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 715/1438] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:20 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:20.551047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:20.551679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:20.558955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:20.559439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:20.559874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:20.560612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:20.561049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:20.561472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:20.628521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:20.636972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3981225a-6ba0-4ed4-a7f7-9c425be3b2a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089839 Aug 09 12:38:20.637565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 724/1439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:20 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:21.519306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:21.519937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:21.527677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:21.528165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:21.528631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:21.529338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:21.529781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:21.530170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:21.596108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:21.610411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-75485aa8-c7ba-4b6e-9968-a14da4e78ebf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094678 Aug 09 12:38:21.611343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 716/1440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:21 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:21.661664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:21.663056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:21.673645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:21.674353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:21.674966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:21.676044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:21.676637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:21.677271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:21.738446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:21.747092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76546edf-2d79-41f9-b00c-0d3748e92eaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091740 Aug 09 12:38:21.747648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 725/1441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:21 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:22.634681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:22.635283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:22.642514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:22.643023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:22.643445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:22.644127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:22.644609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:22.645022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:22.707216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:22.715595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-61d903ae-97f2-4715-97da-60ed51e2d93c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.085489 Aug 09 12:38:22.716172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 717/1442] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:22 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:22.768830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:22.769397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:22.776198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:22.776770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:22.777202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:22.777894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:22.778346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:22.778766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:22.846814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:22.855143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-049cc555-f7de-41ae-a586-5744732de6e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090355 Aug 09 12:38:22.855723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 726/1443] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:22 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:23.736445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:23.737113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:23.744291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:23.744730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:23.745160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:23.745874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:23.746320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:23.746754 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:23.809632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:23.817484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-822b0597-644e-41cc-98bb-d48cdf5e4e09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.085043 Aug 09 12:38:23.818063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 718/1444] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:23 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:23.879976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:23.881945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:23.893667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:23.894471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:23.895190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:23.896675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:23.897270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:23.897687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:23.963053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:23.970985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30e0c180-efb3-4058-bcbc-5ef7d74412aa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098347 Aug 09 12:38:23.971549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 727/1445] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:23 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:24.842686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:24.843600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:24.854850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:24.855635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:24.856344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:24.857523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:24.858264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:24.858960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:24.865576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:24.922265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:24.930248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71b60439-a010-44ab-a140-c73a44c86182 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094085 Aug 09 12:38:24.930812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 719/1446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:24 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:24.997876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:24.998455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:25.006648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:25.007123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:25.007548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:25.008235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:25.008714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:25.009129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:25.084287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:25.089747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:25.097086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-65e46b84-0a47-4e08-9092-c1464e418061 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.104796 Aug 09 12:38:25.097762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 728/1447] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:24 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:25.956964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:25.957967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:25.968965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:25.969805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:25.970491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:25.971638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:25.972419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:25.973133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:26.036424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:26.044229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7d0195d3-7bef-477d-95bf-6a261adddb52 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093819 Aug 09 12:38:26.044787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 720/1448] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:25 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:26.119486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:26.120094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:26.127601 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:26.128089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:26.128591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:26.129329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:26.129783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:26.130207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:26.192404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:26.201167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-482dbab8-5c83-45d3-8010-484e0622e9f6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.086088 Aug 09 12:38:26.201706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 729/1449] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:26 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:27.068734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:27.069605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:27.081038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:27.081749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:27.082396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:27.083474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:27.084162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:27.084828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:27.154797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:27.165517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-196e1c88-ec31-49b2-91ce-599d2733d929 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.103378 Aug 09 12:38:27.166081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 721/1450] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:27 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:27.222832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:27.223401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:27.230642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:27.231126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:27.231561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:27.232254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:27.232742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:27.233178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:27.297306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:27.305281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-78b87d17-48d4-4945-b124-8251ed3e6aad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.086353 Aug 09 12:38:27.305902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 730/1451] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:27 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:28.189716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:28.190717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:28.199365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:28.199846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:28.200281 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:28.201004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:28.201456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:28.201876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:28.268585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:28.276997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a9a5d1ad-88c4-4bb9-b1bd-f89cb9be976f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093857 Aug 09 12:38:28.277560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 722/1452] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:28 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:28.326310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:28.326887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:28.333518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:28.333994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:28.334424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:28.335700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:28.336156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:28.336606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:28.408849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:28.420073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74fb5098-5de4-4aba-acd3-8c1a575ffed7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097634 Aug 09 12:38:28.420893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 731/1453] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:28 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:29.302229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:29.303255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:29.310821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:29.311295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:29.311729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:29.312427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:29.312879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:29.313291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:29.374990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:29.383660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5b8438b6-f23e-4af7-a40c-9065ec3df375 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087909 Aug 09 12:38:29.384244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 723/1454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:29 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:29.446621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:29.447203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:29.449781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:29.455212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:29.455726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:29.456127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:29.456888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:29.457307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:29.457725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:29.522127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:29.530136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d7727ca-4547-47a6-b671-62eb773d4d37 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089137 Aug 09 12:38:29.530701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 732/1455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:29 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:30.409153 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:30.410114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:30.414538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=60 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:30.420409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:30.420921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:30.421348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:30.422027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:30.422474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:30.423538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:30.551543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:30.552174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:30.559592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:30.560088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:30.560562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:30.561288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:30.561743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:30.562173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:30.762301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:30.770481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5955619b-8468-42a2-a8c7-fa920a272bf2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.368279 Aug 09 12:38:30.771066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 724/1456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:30 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:30.788213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:30.795987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e178df29-010a-4248-b8f9-05e74f8c06c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.248420 Aug 09 12:38:30.796581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 733/1457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:30 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:31.793417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:31.794069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:31.801151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:31.801778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:31.802237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:31.803075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:31.803562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:31.804011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:31.816867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:31.817470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:31.824083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:31.824615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:31.825016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:31.825718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:31.826164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:31.826579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:31.873986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:31.881982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8d401be4-590d-4596-b97b-06ec4642f7d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093446 Aug 09 12:38:31.893386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 725/1458] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:31 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:31.894389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:31.899231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-530ae55d-a1dc-49eb-b9f5-9487c69f244d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.086277 Aug 09 12:38:31.899787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 734/1459] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:31 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:32.905549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:32.906167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:32.913446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:32.913952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:32.914386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:32.915100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:32.915499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:32.915940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:32.920736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:32.921406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:32.928051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:32.928567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:32.928998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:32.929678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:32.930129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:32.930542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:32.990155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:32.998788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a9e3c5cb-8fde-49aa-b6c0-3eda2a10734d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098275 Aug 09 12:38:32.999338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 726/1460] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:32 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:33.009253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:33.017074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c2d38c34-8096-461b-874d-909ec8f7d4c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100511 Aug 09 12:38:33.017628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 735/1461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:32 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:34.024103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:34.025112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:34.037141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:34.037949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:34.038707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:34.039894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:34.040827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:34.041614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:34.042590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:34.043243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:34.049513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:34.049994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:34.050417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:34.051105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:34.051551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:34.051970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:34.110749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:34.118452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-93529f2e-22a5-4d44-aed0-8767627b8714 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100914 Aug 09 12:38:34.119028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 727/1462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:34 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:34.126152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:34.135455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67f6b994-35cb-4c40-8101-736ed2560610 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100120 Aug 09 12:38:34.136541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 736/1463] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:34 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:35.144022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:35.144983 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:35.154883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:35.155378 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:35.155816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:35.156596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:35.157393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:35.158141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:35.158675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:35.159292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:35.166508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:35.166991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:35.168152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:35.168335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:35.169047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:35.169570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:35.242377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:35.250457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eb20d5b6-894a-45b5-9003-32124e3fbf8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.113106 Aug 09 12:38:35.251025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 728/1464] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:35 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:35.258578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:35.266774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1cacf43-acfd-4c6b-b8ec-8d88b917e2c4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.112372 Aug 09 12:38:35.267344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 737/1465] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:35 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:36.275628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:36.276703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:36.287510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:36.288308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:36.289080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:36.290221 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:36.290967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:36.291243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:36.291919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:36.292182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:36.299424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:36.299914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:36.300351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:36.301085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:36.301540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:36.301967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:36.361941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:36.369771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1f6b6839-f607-4a8c-b064-97ac10b45612 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100608 Aug 09 12:38:36.370701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 729/1466] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:36 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:36.377789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:36.385455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c3af592-141c-42ee-858b-c51f3fc76b43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100902 Aug 09 12:38:36.386023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 738/1467] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:36 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:37.395211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:37.396200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:37.405336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:37.405816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:37.406251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:37.406942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:37.407393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:37.407815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:37.408328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:37.408959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:37.415143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:37.415617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:37.416044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:37.416761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:37.417209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:37.417692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:37.478824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:37.487093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-67c0c487-45f0-4d97-a1a9-61f0e0597298 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098518 Aug 09 12:38:37.487685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 730/1468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:37 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:37.497961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:37.506058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-91b68855-2b3d-4ecc-bd46-d9a5696bac84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102337 Aug 09 12:38:37.506617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 739/1469] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:37 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:38.512234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:38.512988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:38.519980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:38.520550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:38.521009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:38.521808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:38.522310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:38.522777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:38.527575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:38.528235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:38.535859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:38.536425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:38.536902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:38.537662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:38.538159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:38.538622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:38.596725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:38.604510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4efdeeda-c457-4d52-895f-174d95a4be59 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099074 Aug 09 12:38:38.605363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 731/1470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:38 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:38.613075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:38.621899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1a45692b-c27c-4f4c-a1e6-8a5928595550 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098647 Aug 09 12:38:38.622459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 740/1471] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:38 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:39.630089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:39.631068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:39.642339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:39.643148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:39.643958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:39.645152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:39.645900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:39.646595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:39.647945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:39.649041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:39.657476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:39.657972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:39.658395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:39.659093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:39.659548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:39.659972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:39.719138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:39.727207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-de2d9379-c5ec-45ca-8ca5-3fc643312290 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.104181 Aug 09 12:38:39.728033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 732/1472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:39 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:39.736420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:39.744214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-de375628-9e19-4f72-9199-9048abcdd0a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102731 Aug 09 12:38:39.744815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 741/1473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:39 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:40.752880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:40.753976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:40.763938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:40.764421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:40.764865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:40.765555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:40.766003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:40.766418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:40.767003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:40.767627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:40.774760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:40.775243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:40.775669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:40.776359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:40.776835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:40.777236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:40.839374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:40.847324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20e8bdbc-e225-40bd-ab5a-66af807a863e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101370 Aug 09 12:38:40.847937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 733/1474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:40 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:40.855358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:40.863577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1a328e6e-1dd7-4ac6-b2d1-1c59e708582b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100706 Aug 09 12:38:40.864147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 742/1475] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:40 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:41.872214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:41.873012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:41.881208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:41.881752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:41.882235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:41.883078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:41.883582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:41.884057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:41.894397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:41.895052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:41.902232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:41.903018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:41.903788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:41.904012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:41.904436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:41.904816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:41.953732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:41.961620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f17daa0f-1fc0-4624-a965-e1a40615761b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095778 Aug 09 12:38:41.962202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 734/1476] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:41 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:41.980352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:41.988204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c93357da-c4d7-40be-b231-02b1a0d7ee35 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.107230 Aug 09 12:38:41.988792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 743/1477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:41 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:42.985834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:42.986531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:42.995202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:42.995811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:42.996347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:42.997250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:42.997847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:42.998350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:43.011942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:43.012722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:43.019751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:43.020227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:43.020694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:43.021386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:43.022713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:43.022713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:43.075559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:43.079407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:43.083843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-93635990-059e-46bd-b87d-55756452a00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.104066 Aug 09 12:38:43.084414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 735/1478] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:42 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:43.096338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:43.104424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-823251e5-0c5f-4919-b716-916b19caad0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097266 Aug 09 12:38:43.104953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 744/1479] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:43 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:44.107084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:44.107748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:44.116872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:44.117435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:44.117942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:44.119945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:44.119945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:44.119945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:44.125923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:44.126890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:44.133738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:44.134226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:44.134662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:44.135360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:44.135817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:44.136239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:44.156491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:44.194876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:44.202634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d63d88b-3213-4be9-9dc7-5ff4d5c5837d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100638 Aug 09 12:38:44.203210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 736/1480] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:44 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:44.211173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:44.219429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c80dbc94-91b8-42c7-b6a8-8ff8f45a3996 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098130 Aug 09 12:38:44.220170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 745/1481] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:44 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:45.223916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:45.224690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:45.231623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:45.232072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:45.232528 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:45.233215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:45.233659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:45.234164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:45.239773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:45.240414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:45.247013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:45.247583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:45.248020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:45.248743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:45.249195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:45.249616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:45.302638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:45.310876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-065cfe03-7e14-4bfb-aca3-d426a5b160ff tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091303 Aug 09 12:38:45.311435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 737/1482] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:45 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:45.331817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:45.339695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-53d8498f-5d95-48de-8e1e-14aee39d6b73 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103947 Aug 09 12:38:45.340264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 746/1483] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:45 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:38:46.335987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:46.337034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:46.347089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:46.347573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:46.347999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:46.348722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:46.349163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:46.349582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:46.360924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:46.361539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:46.368349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:46.368859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:46.369293 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:46.369988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:46.370595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:46.371054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:46.413431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:46.421529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b49a7b0c-dd39-449e-929f-18c81b0f3b4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092256 Aug 09 12:38:46.422122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 738/1484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:46 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:46.439272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:46.447082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c810f0b1-a5f0-4d2f-9cb7-1108cbdfd042 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090153 Aug 09 12:38:46.447659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 747/1485] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:46 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:47.447651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:47.448668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:47.457910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:47.458393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:47.458825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:47.459520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:47.459970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:47.460409 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:47.468356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:47.469009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:47.475735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:47.476201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:47.476686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:47.477384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:47.477809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:47.478230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:47.540682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:47.548596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0472e415-cc6c-461a-8bed-67c0d0951dfc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.107927 Aug 09 12:38:47.549177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 739/1486] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:47 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:47.560130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:47.568646 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cd3e9349-fb5e-437d-99ab-d582a4e5eedb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.104170 Aug 09 12:38:47.569237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 748/1487] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:47 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:48.572654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:48.573485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:48.584789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:48.585554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:48.586240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:48.587242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:48.587933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:48.588667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:48.595338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:48.596186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:48.602710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:48.603185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:48.603615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:48.604301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:48.604755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:48.605196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:48.663557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:48.671505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-14f439e0-0535-4422-a25f-4585bbbe942f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.105605 Aug 09 12:38:48.672296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 740/1488] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:48 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:48.683830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:48.691888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0b06ce3-2eae-419e-bc7c-fd1ea2ddce34 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103416 Aug 09 12:38:48.692480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 749/1489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:48 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:49.697343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:49.698507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:49.707632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:49.708116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:49.708575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:49.709296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:49.709741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:49.710179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:49.712485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:49.713182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:49.719428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:49.720195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:49.720523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:49.721217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:49.721674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:49.722090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:49.780923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:49.789511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8b6a34e3-81a2-42e8-9ac2-f94e84fd10f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098620 Aug 09 12:38:49.790086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 741/1490] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:49 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:49.796437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:49.805231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1e043088-31d7-472e-b126-567fdc34cbd4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096457 Aug 09 12:38:49.805881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 750/1491] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:49 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:50.814523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:50.815200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:50.822113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:50.822587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:50.823012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:50.823698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:50.824145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:50.824596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:50.826561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:50.827213 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:50.833897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:50.834376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:50.834805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:50.835497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:50.835941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:50.836355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:50.910777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:50.912216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:50.918583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-60ed86e9-d342-44ae-9be0-7cec939ad50c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.110184 Aug 09 12:38:50.919160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 742/1492] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:50 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:50.920191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7776d331-bcbe-45b9-9469-f84eaee0e346 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097403 Aug 09 12:38:50.920875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 751/1493] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:50 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:51.939698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:51.940284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:51.941269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:51.941882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:51.946960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:51.947441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:51.947876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:51.948037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:51.948529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:51.948719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:51.948970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:51.949132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:51.949449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:51.949668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:51.950119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:51.950539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:52.017493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:52.025455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ff53e71b-0e6c-491b-9779-52b9256c793b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090088 Aug 09 12:38:52.026031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 743/1494] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:51 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:52.033617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:52.041523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f6de8f54-c2fd-4b98-b8d6-3574ab215ace tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.104118 Aug 09 12:38:52.042053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 752/1495] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:51 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:52.225806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:38:52.226172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:38:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:38:53.050372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:53.051424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:53.062332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:53.063180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:53.063718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:53.064410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:53.064885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:53.065152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:53.065643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:53.065758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:53.072583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:53.073099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:53.073543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:53.074243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:53.074693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:53.075371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:53.134797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:53.142575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-52796bcd-fd29-4e45-bb48-933a8ccf7f3e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098767 Aug 09 12:38:53.143131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 744/1496] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:53 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:53.152698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:53.160820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ef500c85-1e92-42be-90e8-a1a2d25537f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.101141 Aug 09 12:38:53.161337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 753/1497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:53 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:54.166713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:54.167600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:54.178101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:54.178587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:54.179006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:54.179698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:54.180146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:54.180607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:54.181490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:54.182096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:54.188858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:54.189852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:54.190303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:54.191004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:54.191462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:54.191880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:54.252714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:54.260423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-931079e6-3ada-49d3-8c2a-e71464faad74 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100268 Aug 09 12:38:54.260969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 745/1498] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:54 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:54.268141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:54.276999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c5a2b906-323c-465f-b401-82c840aaa0d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099071 Aug 09 12:38:54.277777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 754/1499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:54 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:38:55.281684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:55.282292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:55.289156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:55.289630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:55.290060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:55.290741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:55.291187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:55.291609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:55.299357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:55.299912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:55.306707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:55.307320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:55.307755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:55.308509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:55.308962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:55.309405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:55.355234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:55.364671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-801876e4-8611-4776-8ead-4ec0ea341dc9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086835 Aug 09 12:38:55.365249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 746/1500] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:55 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:55.383591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:55.394275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ec2fce2f-9cf6-4f37-b895-dbca4b6ba159 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098809 Aug 09 12:38:55.394838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 755/1501] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:55 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:56.390636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:56.391660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:56.399621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:56.400100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:56.400576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:56.401276 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:56.401728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:56.402149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:56.415071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:56.415919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:56.422664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:56.423169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:56.423713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:56.424259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:56.424766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:56.425267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:56.477999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:56.486217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73a31029-8fb9-449b-8280-4fa800518bf7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102109 Aug 09 12:38:56.486761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 747/1502] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:56 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:56.499550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:56.509490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-19a08c00-6b76-4f0a-a294-5eb82ec9071d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098369 Aug 09 12:38:56.510060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 756/1503] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:56 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:38:57.509967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:57.510617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:57.517358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:57.517834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:57.518261 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:57.519041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:57.519504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:57.519957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:57.530356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:57.531020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:57.537965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:57.538481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:57.538940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:57.539665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:57.540113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:57.540657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:57.599724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:57.607441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-086bf922-bfb0-46c9-ace2-64503f67d637 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101490 Aug 09 12:38:57.608291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 748/1504] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:57 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:57.616105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:57.623918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-377f1707-5590-4ad7-8bde-aa78285817ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097446 Aug 09 12:38:57.624663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 757/1505] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:57 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:58.632965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:58.633922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:58.644933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:58.645415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:58.645852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:58.646549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:58.647005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:58.647428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:58.647998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:58.648639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:58.655412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:58.655898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:58.656316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:58.657049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:58.657503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:58.657990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:58.715557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:58.723419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8319e832-f94d-4464-aefe-40675fe9701b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097618 Aug 09 12:38:58.724000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 749/1506] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:58 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:58.741487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:58.749113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5e324926-389b-4b12-9b64-58f2e7bd4b6a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.106124 Aug 09 12:38:58.749672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 758/1507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:58 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:59.747647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:59.748658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:59.757905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:59.758388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:59.758819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:59.759509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:59.759960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:59.760411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:59.771257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:38:59.771858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:38:59.774468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:59.780372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:59.780890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:59.781318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:59.782030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:38:59.782474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:38:59.782890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:38:59.848890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:59.857361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0653dea4-5828-4e19-b036-049ab1741392 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089956 Aug 09 12:38:59.858061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 759/1508] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:59 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:38:59.985022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:38:59.992681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9e3e5a14-2a5a-49da-9388-063078bd5087 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.251564 Aug 09 12:38:59.993245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 750/1509] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:38:59 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:00.884851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:00.885904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:00.895350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:00.895839 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:00.896271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:00.897001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:00.897456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:00.897864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:00.959681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:00.967863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-63a7df95-4914-4460-b3a3-19feece06297 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090927 Aug 09 12:39:00.968455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 760/1510] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:00 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:01.017005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:01.017633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:01.020887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:01.028175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:01.028882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:01.029504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:01.030365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:01.030951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:01.031531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:01.097358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:01.105281 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4b4fbdaa-e209-404f-8349-507e3bc9f94f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094364 Aug 09 12:39:01.105843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 751/1511] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:01 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:01.993142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:01.994159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:02.004652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:02.005139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:02.005577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:02.006270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:02.006730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:02.007152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:02.078723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:02.086825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fea7ae91-a4b4-4574-8ad8-8d0d144572cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100349 Aug 09 12:39:02.087397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 761/1512] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:01 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:02.136747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:02.137687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:02.146525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:02.147014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:02.147420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:02.148124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:02.148610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:02.149038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:02.167831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:02.212741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:02.225162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3c5f2234-7684-4371-9ad3-cf5e0077769f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094238 Aug 09 12:39:02.225910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 752/1513] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:02 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:03.109271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:03.109897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:03.117287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:03.117778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:03.118218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:03.118908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:03.119365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:03.119778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:03.124309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:03.190508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:03.199094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5ea1af43-0f54-4553-9f12-c027b6b7a39a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095438 Aug 09 12:39:03.199674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 762/1514] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:03 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:03.253001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:03.253774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:03.260713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:03.261401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:03.261839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:03.262516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:03.262988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:03.263410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:03.337755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:03.345977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c264f7c7-309b-433d-9a9a-84877cb969d7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097445 Aug 09 12:39:03.346580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 753/1515] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:03 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:04.223351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:04.223966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:04.231726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:04.232261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:04.232779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:04.233544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:04.234019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:04.234510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:04.310024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:04.319533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-160cdcea-059d-42e8-a331-d5493c993901 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102432 Aug 09 12:39:04.320091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 763/1516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:04 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:04.383853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:04.384910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:04.395300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:04.395788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:04.396227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:04.396962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:04.397416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:04.397842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:04.467329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:04.475420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c9460572-3f00-44a6-9cfa-42c02aefae17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098349 Aug 09 12:39:04.475911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 754/1517] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:04 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:05.341203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:05.341830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:05.348835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:05.349294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:05.349718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:05.350406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:05.350849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:05.351266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:05.413848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:05.421755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-88d37626-dceb-4234-a6c2-56044465747e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.084483 Aug 09 12:39:05.422317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 764/1518] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:05 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:05.496727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:05.497334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:05.504892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:05.505372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:05.505803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:05.506501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:05.506949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:05.507391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:05.574269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:05.586190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-91eaec7a-7e71-4867-b507-d08593a79518 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093312 Aug 09 12:39:05.586826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 755/1519] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:05 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:06.445632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:06.446385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:06.454914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:06.455515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:06.456056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:06.457085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:06.457657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:06.458188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:06.526914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:06.534726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1da4f0f-0dc1-4941-9b92-d4bbeaf94b45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094202 Aug 09 12:39:06.535893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 765/1520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:06 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:06.615528 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:06.616361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:06.624286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:06.624877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:06.625595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:06.626411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:06.627325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:06.627836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:06.693932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:06.701664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01f8ab05-f5fb-4e9c-a557-73159011f9ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091683 Aug 09 12:39:06.702176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 756/1521] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:06 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:07.556188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:07.556919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:07.563551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:07.564043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:07.564520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:07.565432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:07.566126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:07.566553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:07.630650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:07.638390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ddb8881b-6aa4-4b36-a559-77741393c49f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.086535 Aug 09 12:39:07.639158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 766/1522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:07 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:07.722506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:07.723232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:07.729970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:07.730464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:07.730901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:07.731639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:07.732084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:07.732540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:07.803758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:07.812475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3d72e9a-9afc-4c96-a88c-e0714c1819fa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093990 Aug 09 12:39:07.813045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 757/1523] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:07 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:08.665688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:08.666329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:08.673189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:08.673674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:08.674104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:08.674801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:08.675258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:08.675680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:08.739854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:08.748259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd15eeb7-61b2-42d9-9159-86a325e398a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089399 Aug 09 12:39:08.748864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 767/1524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:08 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:08.836396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:08.836987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:08.843546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:08.844027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:08.844497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:08.845187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:08.845640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:08.846059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:08.908810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:08.916740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-74356a30-f5b0-43bc-b4e8-dd0f2e6717c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086078 Aug 09 12:39:08.917229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 758/1525] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:08 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:09.778174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:09.778942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:09.787476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:09.788575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:09.789118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:09.789971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:09.790531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:09.791050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:09.858869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:09.867283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33c5207f-b4ab-4dd4-8807-c8bf5c195ac9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094062 Aug 09 12:39:09.867867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 768/1526] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:09 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:09.937698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:09.938340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:09.945490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:09.945974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:09.946408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:09.947103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:09.947549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:09.947955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:10.014632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:10.027092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d8fa9ecd-50a1-439e-acbd-7e41ed29fdc7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093116 Aug 09 12:39:10.028009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 759/1527] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:10.895282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:10.898324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:10.909408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:10.910199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:10.910927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:10.912093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:10.912918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:10.913634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:10.976842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:10.984803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f38d98db-9b01-40eb-a088-090e5b3bc995 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096185 Aug 09 12:39:10.985383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 769/1528] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:10 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:11.052141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:11.052744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:11.059731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:11.060257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:11.060713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:11.061402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:11.061880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:11.062296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:11.129536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:11.138136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b91a9277-270f-4525-8c4c-934f619c2a25 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089885 Aug 09 12:39:11.138699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 760/1529] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:11 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:12.007483 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:12.008187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:12.016065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:12.016686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:12.017196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:12.017994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:12.018520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:12.019011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:12.086043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:12.094071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e99578f8-97fc-46c3-a063-b98c2b937ad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091319 Aug 09 12:39:12.094632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 770/1530] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:12 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:12.161237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:12.161799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:12.169455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:12.169941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:12.170381 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:12.171077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:12.171504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:12.171949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:12.236182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:12.244702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4b11e003-6378-4d0c-9b9c-c1e2849c4186 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089435 Aug 09 12:39:12.245263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 761/1531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:12 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:13.115422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:13.116169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:13.123344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:13.123829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:13.124267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:13.124995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:13.125447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:13.125877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:13.189650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:13.197976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31a77c9e-a645-4a12-affa-985b6accc033 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.086697 Aug 09 12:39:13.198545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 771/1532] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:13 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:13.270233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:13.271177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:13.282486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:13.283243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:13.283945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:13.285180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:13.285936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:13.286637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:13.350159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:13.358493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e7d2db8-09f2-40cb-b962-a6c1148affc6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094931 Aug 09 12:39:13.359059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 762/1533] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:13 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:14.223615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:14.224185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:14.230913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:14.231397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:14.231822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:14.232536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:14.232993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:14.233409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:14.297778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:14.306402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a927b19e-7be6-4040-9353-a4bdcb533701 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.086410 Aug 09 12:39:14.306996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 772/1534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:14 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:14.379616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:14.380255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:14.386983 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:14.387442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:14.388126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:14.388937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:14.389604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:14.390028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:14.456676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:14.464624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3fa65d89-16f4-4be8-a48e-a1b9d95d42bd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089339 Aug 09 12:39:14.465191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 763/1535] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:14 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:15.331251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:15.332256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:15.341508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:15.341993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:15.342424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:15.343116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:15.343543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:15.343993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:15.414946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:15.423133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc872e89-8a8e-40de-8bfa-b4c6cdf1bc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098392 Aug 09 12:39:15.423699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 773/1536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:15 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:15.489793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:15.490689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:15.501387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:15.502610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:15.503333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:15.504638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:15.505395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:15.506110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:15.571665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:15.579549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3f25130-9078-4bf6-9eeb-3d2ad1af9a26 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096488 Aug 09 12:39:15.580088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 764/1537] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:15 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:16.448078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:16.448724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:16.455971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:16.456502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:16.456956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:16.457681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:16.458154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:16.458602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:16.523846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:16.531559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d477e5f8-3308-4c3b-b0eb-c9925b4e2278 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089678 Aug 09 12:39:16.532123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 774/1538] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:16 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:16.600917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:16.601577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:16.608282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:16.608723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:16.609203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:16.609852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:16.610303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:16.611096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:16.675705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:16.683896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88ecc3d3-853a-48e9-a43c-74519582a0c6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087101 Aug 09 12:39:16.684669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 765/1539] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:16 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:17.554303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:17.555014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:17.562790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:17.563273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:17.563709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:17.564405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:17.564893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:17.565322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:17.635899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:17.643924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-600873f0-aa5a-4517-842d-87a2dbeb53f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094609 Aug 09 12:39:17.644549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 775/1540] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:17 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:17.706830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:17.707655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:17.716648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:17.717329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:17.717946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:17.718912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:17.719565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:17.720221 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:17.785760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:17.793795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a4ab6927-87be-4634-89cc-51f345e6c3bf tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092109 Aug 09 12:39:17.794386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 766/1541] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:17 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:18.665878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:18.666577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:18.673758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:18.674240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:18.674671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:18.675365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:18.675812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:18.676238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:18.744158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:18.753563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-850cc46b-755e-4582-bad4-a29ec47707e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092095 Aug 09 12:39:18.754131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 776/1542] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:18 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:18.817843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:18.818776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:18.828698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:18.829373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:18.829974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:18.830956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:18.831594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:18.832187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:18.900067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:18.908506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c474dc9-b131-4c91-93a5-4c51a41ef7dd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096275 Aug 09 12:39:18.909067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 767/1543] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:18 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:19.778801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:19.779432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:19.786333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:19.786844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:19.787393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:19.788082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:19.788572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:19.788999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:19.851834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:19.860223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f57d4b4-03d0-47a4-8977-5245f8034c0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087986 Aug 09 12:39:19.860826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 777/1544] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:19 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:19.929566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:19.930125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:19.937283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:19.937762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:19.938150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:19.938871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:19.939312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:19.939733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:20.003154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:20.011630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0523af7c-5d71-431e-b749-a53cc9744c17 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.085987 Aug 09 12:39:20.012363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 768/1545] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:19 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:20.886305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:20.887228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:20.894817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:20.895299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:20.895727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:20.896415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:20.896894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:20.897310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:20.963882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:20.967396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:20.971906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e27033c6-155e-48e1-b794-8f489f6a2f86 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092217 Aug 09 12:39:20.972457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 778/1546] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:20 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:21.035866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:21.036995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:21.047072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:21.047759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:21.048417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:21.049395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:21.050043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:21.050854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:21.058007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:21.121949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:21.131094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7d5f6b18-4dd4-4e22-8a44-a2b28d134e34 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101500 Aug 09 12:39:21.131452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 769/1547] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:21 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:21.997301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:21.998455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:22.006920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:22.007462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:22.007922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:22.008718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:22.009225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:22.009684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:22.079281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:22.087023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0c8d76f-4dc4-4b6a-8e9b-33e6e6d51f98 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096325 Aug 09 12:39:22.087573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 779/1548] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:21 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:22.156334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:22.157415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:22.168107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:22.168955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:22.169760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:22.170950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:22.171406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:22.171826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:22.234980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:22.242677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5f40cba1-cf09-4090-9595-a0daedfb7a7b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094166 Aug 09 12:39:22.243243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 770/1549] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:22 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:23.112816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:23.113767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:23.124689 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:23.125477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:23.126188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:23.127694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:23.128548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:23.129172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:23.195958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:23.203789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0b1e1522-21cd-4372-949c-1909a1ab337d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097841 Aug 09 12:39:23.204322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 780/1550] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:23 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:23.268847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:23.270152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:23.281226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:23.281713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:23.282145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:23.282852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:23.283301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:23.283716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:23.360417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:23.372219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1eb2a822-d9f2-4965-a9ed-a598a7e1c4a0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.110314 Aug 09 12:39:23.373139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 771/1551] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:23 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:24.228780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:24.229690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:24.240367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:24.241217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:24.241923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:24.243056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:24.243786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:24.244557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:24.314072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:24.322417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f74e81c4-0e16-4bf5-b5cf-6771d60dc96b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100293 Aug 09 12:39:24.322973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 781/1552] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:24 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:24.394135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:24.394689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:24.401645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:24.402120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:24.402544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:24.403225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:24.403671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:24.404087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:24.465994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:24.473738 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-05941bac-c723-47af-a3d6-1c1982a9aa28 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.083564 Aug 09 12:39:24.474295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 772/1553] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:24 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:25.350954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:25.351961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:25.361954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:25.362439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:25.362847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:25.363572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:25.364027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:25.364486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:25.427375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:25.435504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b3dca8af-3b9e-439a-92de-31db9ce52029 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094682 Aug 09 12:39:25.436066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 782/1554] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:25 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:25.494883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:25.495459 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:25.502898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:25.503371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:25.503799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:25.504514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:25.504964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:25.505406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:25.571243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:25.583111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-76943e2d-1bce-47ad-b326-dae8dff213ae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091911 Aug 09 12:39:25.583942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 773/1555] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:25 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:26.461495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:26.462434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:26.472042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:26.472552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:26.472991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:26.473693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:26.474147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:26.474572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:26.540061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:26.548414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5874744d-9cb1-425f-84cd-9c917fa06466 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093569 Aug 09 12:39:26.549103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 783/1556] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:26 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:26.606937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:26.607537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:26.614241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:26.614720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:26.615147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:26.615831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:26.616271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:26.616733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:26.679114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:26.687168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ee14f4e3-8cee-47e0-b7fc-6f4fcdb1c397 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.084254 Aug 09 12:39:26.687742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 774/1557] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:26 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:27.573971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:27.574994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:27.583600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:27.584084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:27.584558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:27.585259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:27.585713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:27.586157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:27.650697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:27.660336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35f91491-f1df-4ce4-966a-e5287e4189bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092970 Aug 09 12:39:27.660928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 784/1558] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:27 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:27.708026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:27.708640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:27.715636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:27.716118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:27.716597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:27.717286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:27.717740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:27.718161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:27.785504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:27.795246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6651b831-9406-4fd7-99e3-52985d61a0b1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091141 Aug 09 12:39:27.795816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 775/1559] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:27 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:28.685605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:28.686988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:28.695469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:28.695934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:28.696369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:28.697122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:28.697592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:28.698004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:28.762860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:28.771043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-035f7e5d-6c27-4e3f-9de5-32cfa0cd3165 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091990 Aug 09 12:39:28.771604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 785/1560] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:28 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:28.815876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:28.816505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:28.823291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:28.823768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:28.824197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:28.824915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:28.825359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:28.825776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:28.890334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:28.899184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7dcdb72a-16f5-45cc-b343-552663717d75 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087301 Aug 09 12:39:28.899728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 776/1561] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:28 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:29.795464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:29.796466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:29.800198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:29.806359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:29.806814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:29.807279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:29.808031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:29.808509 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:29.808938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:29.872171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:29.880535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a5d1c409-aa64-4ad0-99b9-18fc51ea260a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091513 Aug 09 12:39:29.881466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 786/1562] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:29 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:29.920440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:29.921071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:29.928159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:29.928665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:29.929096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:29.929782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:29.930229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:29.930642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:29.997583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:30.007430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-66a88fe0-0945-4255-bfa0-e7908d1e4422 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090984 Aug 09 12:39:30.007992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 777/1563] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:29 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:30.906384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:30.907371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:30.915738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:30.916241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:30.916721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:30.917414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:30.917904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:30.918316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:30.991354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:31.003440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-be750b38-b4b6-49bb-b3e9-fff12f04ff5c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103490 Aug 09 12:39:31.004012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 787/1564] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:30 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:31.028018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:31.028628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:31.035439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:31.035921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:31.036352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:31.037077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:31.037525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:31.037947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:31.100311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:31.107720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-443c3a07-eef5-45d0-a78b-1ffbe8eda662 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.083603 Aug 09 12:39:31.108286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 778/1565] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:31 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:32.029500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:32.030558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:32.041864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:32.042662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:32.043385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:32.044563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:32.045322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:32.046037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:32.110786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:32.122807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cbecfa29-25ce-4383-8761-17e0d400dba2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099856 Aug 09 12:39:32.123526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 788/1566] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:32 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:32.130039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:32.130637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:32.132975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=56 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:32.138397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:32.138870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:32.139298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:32.139982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:32.140460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:32.140874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:32.210381 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:32.218581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e8258bf-0834-47fe-9a28-9e5e6b9ca1ab tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093131 Aug 09 12:39:32.219125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 779/1567] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:32 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:33.148970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:33.149836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:33.160364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:33.160877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:33.161317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:33.162012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:33.162463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:33.162888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:33.229611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:33.237292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a8423a33-18e7-49f9-8b06-9833d2d30705 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094995 Aug 09 12:39:33.237954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 789/1568] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:33 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:33.239273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:33.239944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:33.246875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:33.247366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:33.247806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:33.248550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:33.249009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:33.249430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:33.317593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:33.325277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fa025f87-5558-4311-a776-2699caa720b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090037 Aug 09 12:39:33.325952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 780/1569] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:33 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:34.262693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:34.263651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:34.271986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:34.272516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:34.272949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:34.273642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:34.274089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:34.274511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:34.335944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:34.343817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-68f6740c-857b-4a35-a58d-f4c509c01fbb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087697 Aug 09 12:39:34.344413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 790/1570] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:34 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:34.346554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:34.347164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:34.354366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:34.354849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:34.355287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:34.355987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:34.356458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:34.356884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:34.428513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:34.436649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-55e533d3-43d1-435e-aa3d-8c7a909d086d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093936 Aug 09 12:39:34.437217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 781/1571] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:34 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:35.368551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:35.369426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:35.378288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:35.379182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:35.379703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:35.380406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:35.380870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:35.381297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:35.454379 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:35.458160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:35.459140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:35.462438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-57bc4b64-56d4-46f8-8723-180cafb614f2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100591 Aug 09 12:39:35.463317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 791/1572] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:35 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:35.466017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:35.466502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:35.466949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:35.467641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:35.468092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:35.468537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:35.542220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:35.550269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-960f886a-3b18-444f-bb7d-ba268c1bf17a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096712 Aug 09 12:39:35.550940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 782/1573] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:35 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:36.488150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:36.489109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:36.496246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:36.496779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:36.497226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:36.497944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:36.498409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:36.498844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:36.561410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:36.570047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-13b64a3d-aaea-4b10-9e80-43f723ba4ed4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.088402 Aug 09 12:39:36.570604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 792/1574] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:36 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:36.571190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:36.571811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:36.582097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:36.582623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:36.583065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:36.583893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:36.584395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:36.584817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:36.647645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:36.655135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-85f3739c-eb84-48f4-85de-156e47a38124 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088534 Aug 09 12:39:36.655696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 783/1575] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:36 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:37.594785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:37.595689 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:37.603469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:37.603949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:37.604581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:37.605336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:37.605779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:37.606194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:37.670470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:37.676044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:37.676644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:37.679056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-416c310e-9062-4a96-bc1b-fb1a74ccfc1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090294 Aug 09 12:39:37.679613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 793/1576] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:37 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:37.683735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:37.684220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:37.684695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:37.685391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:37.685837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:37.686253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:37.748691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:37.761691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-95fd4e57-105a-42dd-b63a-cfcd57972481 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089545 Aug 09 12:39:37.762512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 784/1577] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:37 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:38.704922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:38.705810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:38.713626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:38.714103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:38.714529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:38.715210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:38.715656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:38.716070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:38.782777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:38.783420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:38.789466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:38.790367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:38.790850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:38.791342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:38.791950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:38.792398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:38.792847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:38.796990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-55265aad-d904-4261-9b05-eda8f78a063d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099111 Aug 09 12:39:38.797549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 794/1578] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:38 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:38.856777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:38.860069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:38.865044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8e9ddd4a-a461-4e01-aa31-782c693c35b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086218 Aug 09 12:39:38.865646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 785/1579] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:38 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:39.821861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:39.822489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:39.829387 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:39.829884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:39.830312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:39.831042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:39.831423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:39.831947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:39.850240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:39.886914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:39.888724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:39.896903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:39.897906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:39.898795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:39.899240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:39.899954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:39.900417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:39.900883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:39.905290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5579e742-f397-4ac1-b552-b1a59485d71d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.088474 Aug 09 12:39:39.905844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 795/1580] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:39 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:39.963207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:39.973937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2bf60f6e-bc0d-4f72-a772-5f1fe3e22d7e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090666 Aug 09 12:39:39.974684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 786/1581] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:39 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:40.926790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:40.927358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:40.934449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:40.934934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:40.935365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:40.936078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:40.936531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:40.936953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:40.995866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:40.996507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:41.003720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:41.004182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:41.004645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:41.005348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:41.005724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:41.005912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:41.006337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:41.013875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-773503db-4c90-401a-9fbf-a27f1cbbd2fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091048 Aug 09 12:39:41.014468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 796/1582] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:40 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:41.080826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:41.092251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a341d22e-4bd1-411e-bee9-664debb48861 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100033 Aug 09 12:39:41.093080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 787/1583] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:40 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:42.036889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:42.038142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:42.045148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:42.045632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:42.046061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:42.046754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:42.047206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:42.047626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:42.115933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:42.116576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:42.116746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:42.123483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:42.123970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:42.124307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-665ee3a8-3a3c-4715-8ce1-2632a830c168 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092146 Aug 09 12:39:42.124498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:42.124877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 797/1584] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:42 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:42.125083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:42.125538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:42.125961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:42.187335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:42.195202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ad29492-61f2-4136-8ae6-66bc06de45dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.083346 Aug 09 12:39:42.195773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 788/1585] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:42 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:43.149487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:43.150206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:43.159002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:43.159619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:43.160195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:43.161157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:43.161715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:43.162316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:43.215515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:43.216141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:43.223008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:43.223484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:43.223907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:43.224659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:43.225059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:43.225499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:43.229345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:43.237272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-709234ea-a915-4512-95c2-51b69c07fa22 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094052 Aug 09 12:39:43.237844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 798/1586] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:43 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:43.295391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:43.306516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7e6d2401-2a8f-47c5-bdad-92e8138e9941 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094768 Aug 09 12:39:43.307335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 789/1587] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:43 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:44.263662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:44.264700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:44.275581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:44.276428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:44.277147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:44.278289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:44.279058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:44.279757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:44.331960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:44.332687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:44.339396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:44.339874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:44.340297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:44.341004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:44.341447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:44.341860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:44.346692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:44.355764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-263baaea-9f60-49ec-a5a4-4705b73c9535 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098984 Aug 09 12:39:44.356339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 799/1588] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:44 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:44.412979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:44.421088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a112b666-e883-4c09-9b99-d77a362f3119 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093112 Aug 09 12:39:44.421665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 790/1589] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:44 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:45.381180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:45.382231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:45.393506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:45.394314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:45.395036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:45.396183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:45.396999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:45.397718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:45.442131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:45.442972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:45.449716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:45.450202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:45.450715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:45.451414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:45.451865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:45.452286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:45.462115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:45.469759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-546a47ee-226e-461a-bee0-0cd8409c0fa3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095610 Aug 09 12:39:45.470323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 800/1590] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:45 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:45.519102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:45.527397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bd070e73-74e0-4dad-88c3-dc804f8f669d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089327 Aug 09 12:39:45.527972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 791/1591] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:45 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:46.495598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:46.497251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:46.507915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:46.508629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:46.509051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:46.509738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:46.510157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:46.510609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:46.551926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:46.552687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:46.559502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:46.560085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:46.560641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:46.561359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:46.561863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:46.562301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:46.575626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:46.583422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5b426ad-95f2-4298-8715-5386bbed3462 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094592 Aug 09 12:39:46.583982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 801/1592] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:46 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:46.632040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:46.639791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f50c002a-5548-4205-8c24-53123df4cf70 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091710 Aug 09 12:39:46.640349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 792/1593] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:46 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:47.610486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:47.611434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:47.620924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:47.621400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:47.621829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:47.622512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:47.622955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:47.623369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:47.661385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:47.661978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:47.668929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:47.669400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:47.669835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:47.670576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:47.671034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:47.671455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:47.686114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:47.693829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d183cca5-60b8-4241-a856-cd5f43f3bf4a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089970 Aug 09 12:39:47.694390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 802/1594] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:47 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:47.736588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:47.744746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-24cb8a75-da3e-41ea-8a41-fda88c3047ce tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087237 Aug 09 12:39:47.745335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 793/1595] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:47 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:39:48.715517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:48.716129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:48.722624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:48.723099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:48.723538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:48.724227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:48.724711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:48.725135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:48.766086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:48.766699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:48.773170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:48.773750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:48.774182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:48.774855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:48.775470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:48.775893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:48.787187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:48.795136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-79403349-bc34-48c7-8cbe-d402533d47ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.083751 Aug 09 12:39:48.795709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 803/1596] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:48 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:48.837908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:48.845666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d08772ce-ab83-4c72-8142-8d64405e95cb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.083586 Aug 09 12:39:48.846235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 794/1597] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:48 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:49.819974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:49.821408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:49.832554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:49.833381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:49.834091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:49.840106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:49.840106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:49.840106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:49.866557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:49.867251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:49.874023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:49.874505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:49.874932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:49.875654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:49.876104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:49.876553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:49.903292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:49.910761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8113c29f-a578-4b59-9219-34de136169cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097611 Aug 09 12:39:49.911331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 804/1598] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:49 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:49.948985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:49.956587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e5d40f2-2fd2-43d9-b496-a3e617723506 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093874 Aug 09 12:39:49.957154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 795/1599] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:49 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:50.932156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:50.932790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:50.939565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:50.940142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:50.940606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:50.941299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:50.941741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:50.942155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:50.977558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:50.978171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:50.984992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:50.985475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:50.985906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:50.986615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:50.987060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:50.987478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:51.007078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:51.015407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f77b596-7b18-4821-9e7b-07c84590be96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087167 Aug 09 12:39:51.016002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 805/1600] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:50 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:51.051733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:51.059742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-92181dd2-b3d1-42dd-bb98-6d24cfdbfd73 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086269 Aug 09 12:39:51.060339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 796/1601] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:50 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:52.040597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:52.041625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:52.052576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:52.053382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:52.054117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:52.055188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:52.055648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:52.056072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:52.080292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:52.081627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:52.088909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:52.089318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:52.089741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:52.090418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:52.090849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:52.091265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:52.117018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:52.124934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c6597149-4aab-4c43-adca-4c58247503c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090878 Aug 09 12:39:52.125739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 806/1602] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:52 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:52.156306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:52.163868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fb907763-7d4a-41f7-83e3-a0a7ab920cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087427 Aug 09 12:39:52.164419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 797/1603] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:52 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:53.152261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:53.153170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:53.163295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:53.164095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:53.165153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:53.165886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:53.166341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:53.166764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:53.184692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:53.185363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:53.192125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:53.192646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:53.193070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:53.193760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:53.194217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:53.194625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:53.230491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:53.238163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd127f85-6c9e-4df5-bdb6-1b76d30d9354 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094313 Aug 09 12:39:53.238744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 807/1604] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:53 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:53.258742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:53.266648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-07dd859a-5e6c-436f-a005-0c99a158d5db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.085858 Aug 09 12:39:53.267222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 798/1605] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:53 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:54.263435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:54.264435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:54.274841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:54.275321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:54.275749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:54.276424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:54.276900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:54.277320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:54.287210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:54.287810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:54.295096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:54.295582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:54.296010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:54.296700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:54.297176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:54.297649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:54.350378 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:54.358297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3fcfd0cf-5fff-4a41-9547-cf475297adaa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.101317 Aug 09 12:39:54.358899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 808/1606] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:54 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:54.371943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:54.379993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-50e530a1-1db3-4875-a625-1091f5aac6c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096691 Aug 09 12:39:54.380591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 799/1607] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:54 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:55.382330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:55.383224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:55.390171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:55.390654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:55.391085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:55.391776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:55.392224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:55.392671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:55.401143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:55.402007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:55.408662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:55.409160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:55.409592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:55.410297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:55.410750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:55.411159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:55.457601 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:55.465752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-964b4536-5dbe-4b09-9eb3-a8432f85e742 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.088679 Aug 09 12:39:55.466362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 809/1608] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:55 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:55.483716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:55.491822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-54f944d5-6e76-4dc2-a8e1-f4b39231bd1a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094615 Aug 09 12:39:55.492614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 800/1609] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:55 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:56.491533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:56.492749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:56.499702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:56.500211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:56.500702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:56.501431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:56.501906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:56.502683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:56.513812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:56.514501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:56.521731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:56.522238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:56.522696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:56.523746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:56.524264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:56.524711 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:56.574622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:56.583710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3eff8c1c-ade2-4fb3-ac75-5c2dc1ac5f8c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098699 Aug 09 12:39:56.584512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 810/1610] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:56 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:56.594546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:56.602438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-18fe559b-049a-48a4-926b-d4b6091f6496 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092832 Aug 09 12:39:56.603023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 801/1611] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:56 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:57.607629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:57.608346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:57.616603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:57.617199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:57.618326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:57.619181 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:57.619739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:57.620259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:57.624513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:57.625262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:57.633817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:57.634325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:57.634698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:57.635424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:57.635880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:57.636328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:57.657493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:57.700783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:57.708606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46c5ad80-bc6b-40b1-9717-7da3121b49b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.106071 Aug 09 12:39:57.709234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 811/1612] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:57 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:57.720717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:57.729046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-31e84950-3080-41cb-95de-c477710c673d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.109500 Aug 09 12:39:57.729610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 802/1613] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:57 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:58.730157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:58.730784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:58.737514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:58.738026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:58.738462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:58.739152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:58.739669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:58.740089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:58.744277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:58.750126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:58.750703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:58.757972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:58.758452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:58.758876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:58.759565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:58.760011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:58.760457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:58.803590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:58.811421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-062d736c-9629-4f3a-a13c-1eca9916eeb0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.085407 Aug 09 12:39:58.812161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 812/1614] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:58 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:58.829888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:58.837622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f18f5e5f-dd35-4642-8464-3aea63d4548d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091770 Aug 09 12:39:58.838214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 803/1615] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:58 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:59.836704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:59.837765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:59.841595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:59.849869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:59.850704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:59.853195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:59.853195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:59.853195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:59.853549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:59.858462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:39:59.859096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:39:59.865479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:59.866099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:59.866524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:59.867236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:39:59.867668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:39:59.868113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:39:59.931785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:59.939436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2db00d41-e7a2-4596-9e49-a28701293496 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.109134 Aug 09 12:39:59.940011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 813/1616] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:59 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:39:59.951172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:39:59.958939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88781ea6-62b3-4b41-8d36-21a55cec4fe9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.104438 Aug 09 12:39:59.959495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 804/1617] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:39:59 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:00.963720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:00.964290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:00.971338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:00.971807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:00.972235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:00.972955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:00.973402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:00.973814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:00.979712 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:00.980318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:00.987076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:00.987556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:00.987982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:00.989115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:00.989115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:00.989567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:01.037914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:01.046496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d5e53e0-bac9-42b1-8e01-2e73536aeb0d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087750 Aug 09 12:40:01.047293 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 814/1618] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:00 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:01.064202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:01.072360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1fa1a883-918b-4355-9be8-e76f01b816dc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097024 Aug 09 12:40:01.072959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 805/1619] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:00 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:02.071142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:02.071774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:02.078925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:02.079432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:02.079921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:02.080658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:02.081137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:02.081581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:02.093270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:02.093800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:02.101109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:02.101599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:02.102171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:02.102877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:02.103332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:02.103766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:02.153298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:02.161249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-733a8204-da4f-45a4-a1ad-c9b8767b2131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096910 Aug 09 12:40:02.162101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 815/1620] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:02 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:02.174337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:02.182137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-39fa643d-97c6-4468-8430-6474810ef293 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093053 Aug 09 12:40:02.182697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 806/1621] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:02 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:03.186935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:03.187637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:03.195833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:03.196629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:03.197274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:03.198187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:03.198790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:03.199346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:03.205405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:03.206210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:03.209522 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=56 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:03.215950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:03.216417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:03.216884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:03.217580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:03.218039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:03.218467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:03.276142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:03.283852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4ffd22a-ad4c-473c-8c90-c7c2ccbaedfd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103920 Aug 09 12:40:03.284422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 816/1622] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:03 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:03.292422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:03.299930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fb688d83-3789-4d16-bebf-562d2f4896d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099804 Aug 09 12:40:03.300506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 807/1623] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:03 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:04.309449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:04.310377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:04.321577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:04.322031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:04.322484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:04.323168 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:04.323609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:04.323771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:04.324169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:04.324336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:04.331151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:04.331614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:04.332074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:04.332803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:04.333254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:04.333777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:04.393892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:04.402394 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2ee34799-9652-435a-b728-a5281f5f453a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099920 Aug 09 12:40:04.403184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 817/1624] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:04 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:04.409021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:04.417052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eddb57c0-290e-4a78-bebe-9e8e85767527 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098365 Aug 09 12:40:04.417609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 808/1625] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:04 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:05.427731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:05.428756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:05.436802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:05.437377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:05.437805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:05.438376 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:05.438877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:05.438991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:05.439094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:05.439441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:05.448842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:05.449597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:05.450220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:05.451287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:05.452040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:05.452881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:05.532108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:05.546610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56ffc098-ccec-4ad5-8d2c-4fba7cde8c1a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.125814 Aug 09 12:40:05.548835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 818/1626] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:05 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:05.558110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:05.566313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b95b2880-ef2f-439f-973a-e092b83c7b56 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.131968 Aug 09 12:40:05.567156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 809/1627] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:05 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:40:06.580136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:06.580825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:06.587953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:06.588648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:06.588778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:06.588875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:06.589170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:06.589879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:06.590334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:06.590727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:06.599909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:06.600445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:06.600873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:06.601580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:06.602081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:06.602504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:06.661372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:06.669814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5dd1bf71-c694-47ac-90be-84caace40317 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093606 Aug 09 12:40:06.670391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 819/1628] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:06 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:06.676605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:06.684638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4aa2960b-300e-4878-ac90-87514d6c873e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101278 Aug 09 12:40:06.685185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 810/1629] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:06 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:40:07.691433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:07.692043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:07.698703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:07.699215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:07.699645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:07.700336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:07.700797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:07.701243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:07.705988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:07.706614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:07.713739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:07.714215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:07.714661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:07.715322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:07.715760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:07.716177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:07.774292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:07.782568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d2aca2f-7eca-4d72-b436-b1ca0f833b96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095062 Aug 09 12:40:07.783135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 820/1630] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:07 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:07.794546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:07.806175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c3f9672-5956-4f90-964a-230c2c421c4b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.103899 Aug 09 12:40:07.806836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 811/1631] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:07 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:08.807630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:08.808312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:08.816262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:08.817180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:08.817611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:08.818306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:08.818751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:08.819164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:08.827560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:08.828178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:08.834394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:08.834866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:08.835296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:08.835981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:08.836458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:08.836880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:08.883967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:08.893404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7030cd6d-39a8-4d92-91c0-5cb7f3948bbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092283 Aug 09 12:40:08.894005 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 821/1632] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:08 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:08.911002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:08.918734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-54c00368-c009-41d9-abd0-a803efb8d699 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095237 Aug 09 12:40:08.919306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 812/1633] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:08 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:40:09.913750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:09.914460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:09.921605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:09.922085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:09.922524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:09.923214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:09.923667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:09.924090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:09.939247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:09.939858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:09.947122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:09.947606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:09.948036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:09.948766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:09.949303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:09.949727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:09.988552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:09.997493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6eb642f3-e234-4918-8ed8-8d4edbf97956 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087885 Aug 09 12:40:09.998079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 822/1634] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:09 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:10.018243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:10.025890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-66411d3e-eded-4d53-9487-c800c459652e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090616 Aug 09 12:40:10.026458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 813/1635] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:11.022799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:11.023780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:11.031917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:11.032429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:11.032888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:11.033559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:11.034021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:11.034440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:11.046782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:11.047338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:11.053984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:11.054493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:11.054920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:11.055610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:11.056051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:11.056490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:11.103531 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:11.111454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aa99df8c-e4c0-4011-aec3-ee15c4ffd379 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095137 Aug 09 12:40:11.112029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 823/1636] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:11 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:11.123478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:11.131640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b89309d4-6d53-409e-b410-2c042b85deda tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088991 Aug 09 12:40:11.134173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 814/1637] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:11 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:12.137356 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:12.138033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:12.144760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:12.145245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:12.145678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:12.146374 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:12.146830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:12.147252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:12.153604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:12.154291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:12.160920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:12.161399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:12.161832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:12.162515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:12.162964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:12.163382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:12.218455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:12.226496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9b01e159-771c-4c92-a3d1-14e0119ecc4d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096165 Aug 09 12:40:12.236429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 824/1638] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:12 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:12.239032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:12.246864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4ebebe35-6ab5-45b6-818f-147b2e1e659e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097178 Aug 09 12:40:12.247490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 815/1639] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:12 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:13.257526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:13.258505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:13.269981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:13.270779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:13.271337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:13.272111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:13.272303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:13.272701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:13.273492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:13.274184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:13.281574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:13.282052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:13.282479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:13.283192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:13.283997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:13.283997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:13.356668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:13.365094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-26ba97f5-704e-49b3-810c-21a860611c65 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.114524 Aug 09 12:40:13.365892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 825/1640] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:13 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:13.372107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:13.380336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-022482e9-e89b-4582-a17e-ab2847f771c3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.115461 Aug 09 12:40:13.380923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 816/1641] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:13 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:14.389692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:14.390389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:14.397849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:14.398430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:14.398910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:14.399840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:14.400350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:14.400855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:14.402941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:14.403618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:14.413575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:14.413941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:14.414434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:14.415211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:14.415705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:14.416172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:14.469236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:14.477956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-698962dc-3262-4de4-b471-569576266a14 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094309 Aug 09 12:40:14.478776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 826/1642] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:14 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:14.496704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:14.504817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c89d9e3-ef4a-4c15-a171-5a13eb5c216a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.106128 Aug 09 12:40:14.505402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 817/1643] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:14 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:15.502278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:15.503393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:15.512183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:15.512870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:15.513437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:15.514425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:15.515017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:15.515573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:15.528040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:15.528879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:15.535976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:15.536507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:15.536977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:15.537675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:15.538123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:15.538544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:15.585058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:15.593082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d1dbce8-f937-49c7-912c-0372bd29d29d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096531 Aug 09 12:40:15.593632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 827/1644] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:15 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:15.611690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:15.620614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3fd7f67e-a965-4909-8b8f-500c2e768cfd tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097664 Aug 09 12:40:15.621176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 818/1645] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:15 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:16.614375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:16.615022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:16.623630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:16.624100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:16.624693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:16.625429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:16.626035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:16.626584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:16.649060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:16.649604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:16.656216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:16.656732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:16.657167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:16.657864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:16.658300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:16.658735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:16.662814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:16.691427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:16.694835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:16.699869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-04d16cc0-a10d-4070-958d-2ebac4946676 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089600 Aug 09 12:40:16.700445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 828/1646] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:16 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:16.728193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:16.737311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-303bf119-d5ff-4fbe-a167-597495a4a653 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092698 Aug 09 12:40:16.737894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 819/1647] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:16 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:17.723086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:17.723715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:17.730554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:17.731030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:17.731517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:17.732210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:17.732684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:17.733222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:17.758772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:17.759376 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:17.765860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:17.766330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:17.766756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:17.767461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:17.767901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:17.768313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:17.794627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:17.802396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eebad0e3-23b4-47cf-8bc7-b71ab08dd78e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.083906 Aug 09 12:40:17.802990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 829/1648] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:17 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:17.831556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:17.839188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-56f8f6e3-0ee8-4e3e-bd83-e096ff905072 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.084596 Aug 09 12:40:17.839754 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 820/1649] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:17 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:18.828022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:18.828674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:18.835785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:18.836274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:18.836745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:18.837440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:18.837896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:18.838315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:18.861957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:18.862546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:18.869623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:18.870107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:18.870563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:18.871560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:18.872010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:18.872476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:18.908779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:18.917001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-342413b4-95b8-4476-9da4-52b9045b6dd8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095134 Aug 09 12:40:18.917576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 830/1650] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:18 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:18.936992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:18.945187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9f034020-a074-4b4e-b2e3-c2b1d8a4932d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088383 Aug 09 12:40:18.945756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 821/1651] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:18 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:19.939424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:19.940056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:19.946984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:19.947470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:19.947930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:19.948664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:19.949137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:19.949564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:19.966131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:19.966724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:19.973709 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:19.974199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:19.974631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:19.975321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:19.975770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:19.976188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:20.013781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:20.021800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2a2b65a-c358-4c98-b2fa-f62c9cff03a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087791 Aug 09 12:40:20.022390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 831/1652] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:19 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:20.044725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:20.052865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3db4eade-8a23-49ec-8e5a-39d9c8f55f35 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090732 Aug 09 12:40:20.053440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 822/1653] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:19 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:21.046917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:21.047567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:21.054162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:21.054648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:21.055110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:21.055901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:21.056455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:21.056882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:21.075068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:21.075655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:21.082576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:21.083053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:21.083696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:21.084605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:21.085055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:21.085478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:21.148995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:21.156897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-502f3507-a66f-4f6f-924e-68771a2e72fd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.116557 Aug 09 12:40:21.157777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 832/1654] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:21 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:21.170079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:21.178020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2bfbc4c5-9b3b-4e7b-a8ff-78e69d1f07d1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.106793 Aug 09 12:40:21.178598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 823/1655] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:21 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:22.181515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:22.182494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:22.191206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:22.191688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:22.192123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:22.192859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:22.193316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:22.193738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:22.201474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:22.202088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:22.209063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:22.209545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:22.209962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:22.210668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:22.211117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:22.211540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:22.269609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:22.277499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5f3759d0-1516-40f7-b578-e9204a8cbcc3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102611 Aug 09 12:40:22.278108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 833/1656] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:22 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:22.286005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:22.293704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e9cea5a0-8d84-4cc0-9885-0fd9a215f716 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096082 Aug 09 12:40:22.294242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 824/1657] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:22 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:23.299015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:23.299643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:23.306397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:23.307031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:23.307463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:23.308177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:23.308647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:23.309061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:23.314802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:23.315595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:23.322398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:23.322890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:23.323326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:23.324189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:23.324686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:23.325078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:23.374886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:23.383294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d356e543-f046-4432-9abd-90183d67341b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089023 Aug 09 12:40:23.383869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 834/1658] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:23 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:23.402009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:23.413235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fb2c6a3d-2778-433e-bac1-af95d746e77e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102677 Aug 09 12:40:23.413986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 825/1659] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:23 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:24.409218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:24.410162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:24.421053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:24.421853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:24.422579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:24.423726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:24.424542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:24.425251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:24.437866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:24.438490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:24.445297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:24.445783 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:24.446218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:24.446912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:24.447361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:24.447785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:24.496317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:24.505314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56e37f88-cf54-494e-a3b6-33ba927b2672 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102832 Aug 09 12:40:24.505893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 835/1660] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:24 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:24.523603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:24.531708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-688865cb-1e49-46f0-80f2-464d6efb6d4c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100842 Aug 09 12:40:24.532240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 826/1661] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:24 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:25.525090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:40:25.526206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:40:25.532133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:25.532958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:25.543756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:25.544610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:25.545354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:25.546930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:25.547201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:25.547542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:25.553387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:25.553993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:25.560797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:25.561274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:25.561701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:25.562640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:25.563174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:25.563573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:25.609954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:25.619673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8d546c6-2c65-4505-ad6e-581b9951f2e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095123 Aug 09 12:40:25.620666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 836/1662] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:25 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:25.639597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:25.647596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-67a1cf23-278e-4b51-8c7d-d8ecb1fe5aea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098091 Aug 09 12:40:25.648155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 827/1663] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:25 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:26.641072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:26.641809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:26.648823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:26.649305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:26.649742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:26.650438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:26.650888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:26.651310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:26.668484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:26.669077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:26.675657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:26.676134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:26.676598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:26.677404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:26.677853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:26.678271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:26.717538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:26.725925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0e1ff92-d004-4d14-83ce-3d5585dabffe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.088907 Aug 09 12:40:26.726508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 837/1664] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:26 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:26.743532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:26.751311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5a23141e-57a1-4fc4-8623-43677054f634 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086752 Aug 09 12:40:26.751839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 828/1665] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:26 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:27.750561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:27.751515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:27.762833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:27.763638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:27.764464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:27.765617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:27.766145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:27.766576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:27.771891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:27.772589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:27.779430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:27.779915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:27.780345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:27.781052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:27.781532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:27.781956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:27.838874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:27.847029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-19122698-b4ce-4a98-bf24-a002d0019c9a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103088 Aug 09 12:40:27.847639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 838/1666] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:27 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:27.857932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:27.866377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7dd7207d-aff4-467e-b06a-9e54003d35c1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098398 Aug 09 12:40:27.866954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 829/1667] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:27 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:28.872355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:28.873364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:28.881272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:28.881810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:28.882172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:28.882908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:28.883365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:28.883764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:28.888265 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:28.888913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:28.896896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:28.897464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:28.897972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:28.898743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:28.899266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:28.899760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:28.954365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:28.962355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-da7f1008-f147-48ed-804b-76806f3a793d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096490 Aug 09 12:40:28.962923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 839/1668] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:28 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:28.977293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:28.989311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5810cf1-81e1-4006-b78d-833c07cd062c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.105454 Aug 09 12:40:28.990133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 830/1669] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:28 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:29.987060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:29.987740 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:29.990475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:29.996485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:29.997018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:29.997502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:29.998272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:29.998780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:29.999254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:30.014520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:30.015211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:30.022125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:30.022674 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:30.023120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:30.023805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:30.024262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:30.024726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:30.068080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:30.075929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-57fdafc4-4c1d-4fad-85aa-ca116a55c6b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094225 Aug 09 12:40:30.076528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 840/1670] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:29 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:30.093941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:30.101497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2706831f-440a-4c64-8ca8-1924c2b2a783 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091379 Aug 09 12:40:30.102053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 831/1671] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:30 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:30.135578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:40:30.135738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:40:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:40:31.101262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:31.102316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:31.112105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:31.112616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:31.113042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:31.113732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:31.114177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:31.114599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:31.122523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:31.123486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:31.130663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:31.131154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:31.131590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:31.132291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:31.132877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:31.133282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:31.189737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:31.197568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db2e814c-1440-452c-bc5a-5c8252d872f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103109 Aug 09 12:40:31.198126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 841/1672] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:31 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:31.208858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:31.219794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dc615a6d-2c06-42e3-92e8-359009dc12f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100765 Aug 09 12:40:31.220555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 832/1673] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:31 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:31.936959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:40:31.937290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:40:32.222215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:32.222775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:32.229662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:32.230140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:32.230595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:32.231279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:32.231731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:32.232152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:32.246040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:32.246610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:32.253987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:32.254468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:32.254892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:32.255583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:32.256027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:32.256462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:32.306603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:32.315081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8a59ab6-b1d3-487e-9d4a-db0cbb49ad47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097446 Aug 09 12:40:32.315626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 842/1674] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:32 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:32.322586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:32.330244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6109ad5b-b56f-43f9-8f8e-9dfb243133b3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088203 Aug 09 12:40:32.330797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 833/1675] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:32 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:33.340161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:33.341172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:33.352279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:33.353123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:33.353846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:33.354482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:33.355301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:33.355487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:33.355750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:33.356543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:33.359237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:33.364334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:33.364885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:33.365318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:33.366097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:33.366550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:33.366972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:33.425855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:33.433657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-728ac812-6c24-42ce-aad9-b5a37915de1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100166 Aug 09 12:40:33.434226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 843/1676] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:33 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:33.441912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:33.449966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a4d1062e-f469-4bf1-b162-29670b1585eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101897 Aug 09 12:40:33.450529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 834/1677] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:33 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:34.455453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:34.456047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:34.463208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:34.463691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:34.464119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:34.464902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:34.465358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:34.465905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:34.471052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:34.471723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:34.478321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:34.478797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:34.479219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:34.479904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:34.480345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:34.480804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:34.538955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:34.546897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a801ded-a303-48f7-8ef3-69c088211ab3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095318 Aug 09 12:40:34.547508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 844/1678] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:34 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:34.561048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:34.565146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:34.569744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0bd961ab-fbf0-4fc7-a870-a2ed140cae5c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102867 Aug 09 12:40:34.570310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 835/1679] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:34 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:35.572102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:35.573153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:35.581688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:35.582151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:35.582578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:35.583264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:35.583707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:35.584151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:35.591140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:35.591718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:35.599370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:35.599370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:35.599892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:35.600657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:35.601138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:35.601617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:35.602447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:35.660407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:35.667989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff2b95e4-c177-449c-8d7d-54d935d7cc97 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102489 Aug 09 12:40:35.668548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 845/1680] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:35 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:35.680396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:35.688185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c69760a0-c7ec-44b3-b078-8ec3c57fa022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101270 Aug 09 12:40:35.688772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 836/1681] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:35 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:36.690152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:36.690925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:36.698288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:36.698817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:36.699288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:36.700041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:36.700573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:36.701034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:36.710272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:36.711718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:36.718929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:36.720090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:36.720090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:36.720781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:36.721252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:36.721662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:36.775266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:36.783054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f40edc0-7f45-4810-86ae-5cb44abd28d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097441 Aug 09 12:40:36.783751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 846/1682] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:36 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:36.794305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:36.804619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-835522c0-c930-43a9-90ae-ecd67a8a4cca tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098385 Aug 09 12:40:36.805399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 837/1683] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:36 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:40:37.806727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:37.807544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:37.815473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:37.816078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:37.816734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:37.817599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:37.818170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:37.818698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:37.829507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:37.830371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:37.838202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:37.838685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:37.839110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:37.839803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:37.840251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:37.840750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:37.889224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:37.897921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2240484a-5838-4ca8-9cdb-8e1ccfc3378a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096152 Aug 09 12:40:37.898605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 847/1684] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:37 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:37.915692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:37.923239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1f610061-816d-4d1a-814c-23318332a5d8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098744 Aug 09 12:40:37.923797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 838/1685] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:37 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:38.918929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:38.919539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:38.926902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:38.927378 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:38.927807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:38.928520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:38.928959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:38.929372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:38.943479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:38.944271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:38.950556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:38.951036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:38.951457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:38.952146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:38.952627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:38.953048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:39.000918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:39.009983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b73252af-ab24-4f00-9802-790571490311 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095040 Aug 09 12:40:39.010552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 848/1686] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:38 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:39.017837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:39.025778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffcee5d8-faaf-4ede-bc82-97adffc16376 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086447 Aug 09 12:40:39.026306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 839/1687] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:38 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:40.035505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:40.037376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:40.048431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:40.049230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:40.049943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:40.050824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:40.052088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:40.052088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:40.052722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:40.052827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:40.058893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:40.059321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:40.059737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:40.060509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:40.060961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:40.061381 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:40.120982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:40.129195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6062b5a8-ceba-40b9-96af-36ceb031aa4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100282 Aug 09 12:40:40.129781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 849/1688] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:40 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:40.139390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:40.148756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-75f59cd8-dcd2-4d16-b8c9-edf14f950103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.104633 Aug 09 12:40:40.149296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 840/1689] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:40 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:41.154778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:41.156869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:41.167599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:41.168080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:41.168544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:41.169235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:41.169678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:41.170080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:41.170590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:41.170695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:41.177606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:41.178092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:41.178547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:41.179247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:41.179701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:41.180130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:41.251380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:41.253620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:41.260120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-745c1b53-3523-448a-bbb8-8a074ce3008d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094141 Aug 09 12:40:41.260833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 841/1690] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:41 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:40:41.262275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7cfde23a-c314-4f1f-8cf7-098d4ada8ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.114639 Aug 09 12:40:41.262844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 850/1691] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:41 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:42.287030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:42.288174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:42.288874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:42.289893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:42.298919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:42.299733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:42.300448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:42.301884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:42.302759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:42.303239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:42.304220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:42.304746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:42.305179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:42.305884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:42.306339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:42.306759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:42.409120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:42.413151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:42.422817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c2869fab-e8a2-41ed-84c8-24480e904737 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.142012 Aug 09 12:40:42.423731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 851/1692] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:42 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:42.426994 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-aee7a959-7122-452b-a8cb-1d80100aaac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.147895 Aug 09 12:40:42.428298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 842/1693] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:42 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:43.448329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:43.449203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:43.450850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:43.451683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:43.457437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:43.458039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:43.458573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:43.459436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:43.460269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:43.460830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:43.461016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:43.461716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:43.462296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:43.463161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:43.463726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:43.464230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:43.818653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:43.821217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:43.830821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6e5cc37-ca90-47bb-a1c8-f92d7677c395 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.387375 Aug 09 12:40:43.831597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 852/1694] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:43 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:43.833154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8f173f70-24e3-48df-9003-342a0003765d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.386580 Aug 09 12:40:43.834065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 843/1695] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:43 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:44.857336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:44.858285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:44.858465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:44.859423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:44.869910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:44.870530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:44.870814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:44.871302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:44.871591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:44.872037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:44.872564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:44.873209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:44.873496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:44.873979 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:44.874191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:44.874689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:44.957336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:44.959324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:44.965850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2306f0b-75b4-491f-8d25-053e85de14fc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.115968 Aug 09 12:40:44.966428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 853/1696] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:44 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:44.967612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4222e07d-6a55-4837-89f6-52382481e8c2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.115690 Aug 09 12:40:44.968169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 844/1697] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:44 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:45.988149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:45.988789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:45.989171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:45.989287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:45.995732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:45.995938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:45.996209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:45.996403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:45.996684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:45.996849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:45.997376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:45.997531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:45.997823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:45.997989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:45.998241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:45.998404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:46.070434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:46.078365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c661de1-debc-4b82-af8a-890421ac0abc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093875 Aug 09 12:40:46.078926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 845/1698] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:45 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:46.085747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:46.094234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc8f08bf-a067-479e-a60a-c720fe8629bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.109841 Aug 09 12:40:46.095004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 854/1699] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:45 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:47.102826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:47.103441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:47.110821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:47.111329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:47.111794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:47.112545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:47.113023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:47.113468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:47.115648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:47.116653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:47.123701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:47.124204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:47.124679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:47.125397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:47.125866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:47.126304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:47.185517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:47.193249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-029b5c14-07f6-49fc-b669-230d9538a959 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095617 Aug 09 12:40:47.200437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 846/1700] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:47 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:47.205329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:47.216830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c298fe0-6d9a-47dc-a62c-18684e78413b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.104976 Aug 09 12:40:47.217549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 855/1701] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:47 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:48.219275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:48.220162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:48.231118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:48.231909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:48.232691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:48.233884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:48.235059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:48.235619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:48.242749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:48.243364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:48.250074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:48.250554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:48.251119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:48.251815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:48.252266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:48.252716 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:48.308974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:48.317061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c7ecd611-aa6f-43a8-acfd-14006ff5ccae tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.104554 Aug 09 12:40:48.317613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 847/1702] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:48 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:48.330113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:48.339756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5933172a-54ec-4045-9822-026d3e5e5f12 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103170 Aug 09 12:40:48.340294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 856/1703] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:48 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:49.342739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:49.343712 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:49.353070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:49.353545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:49.353970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:49.354661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:49.355103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:49.355521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:49.366221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:49.366799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:49.373337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:49.373814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:49.374239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:49.374948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:49.375655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:49.376075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:49.426571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:49.435146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4ac67c1e-ac26-4ab3-8209-cbf581a617b8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099064 Aug 09 12:40:49.435725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 848/1704] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:49 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:49.442371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:49.450238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c128c262-7cf1-4372-9620-e77f170e6fdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.088123 Aug 09 12:40:49.450791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 857/1705] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:49 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:50.460271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:50.460985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:50.468500 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:50.469037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:50.469511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:50.470275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:50.470770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:50.470938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:50.471397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:50.471514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:50.479077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:50.479634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:50.480119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:50.480921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:50.481444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:50.481912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:50.563043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:50.565660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:50.575358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-67fd4899-a479-4720-bc6f-cfd4df7b2022 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.120898 Aug 09 12:40:50.576235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 849/1706] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:50 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:50.576632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4233b2bc-7269-4f7b-81e8-c2184577d6d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.110023 Aug 09 12:40:50.577498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 858/1707] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:50 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:51.602202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:51.602823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:51.603173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:51.603798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:51.609736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:51.610367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:51.610492 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:51.610598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:51.610785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:51.611218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:51.611356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:51.611718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:51.611901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:51.612136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:51.612346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:51.612795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:51.692575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:51.695048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:51.700234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-90eaf838-7a14-403f-bc5d-33c3124fb195 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.103175 Aug 09 12:40:51.700835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 850/1708] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:51 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:51.703352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8741733-32e2-40a1-9fbf-56176649fa42 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.104965 Aug 09 12:40:51.703911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 859/1709] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:51 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:52.725837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:52.726835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:52.728440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:52.729587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:52.737637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:52.738432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:52.739134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:52.739810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:52.740283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:52.740617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:52.741130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:52.741320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:52.741578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:52.741842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:52.742285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:52.742687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:52.827043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:52.828642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:52.834857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3afed52a-5add-4903-9a70-e4c0d190f05e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.115986 Aug 09 12:40:52.835397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 851/1710] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:52 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:52.836627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9b63d0aa-27c7-4d9b-bd50-6cb8e461b8d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.114774 Aug 09 12:40:52.837195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 860/1711] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:52 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:53.859973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:53.861060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:53.861328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:53.862127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:53.872739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:53.873490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:53.873703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:53.874246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:53.874459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:53.875014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:53.875386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:53.876153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:53.876440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:53.876837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:53.877041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:53.877681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:53.899054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:53.950889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:53.958589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45fd2c37-340c-4a93-87f6-a12ba44e9e0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103818 Aug 09 12:40:53.959770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 861/1712] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:53 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:53.965800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:53.973516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-14886f23-a6c6-42ff-bc06-4325d6176b9f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.120148 Aug 09 12:40:53.974079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 852/1713] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:53 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:54.984305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:54.985517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:54.995559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:54.996048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:54.996549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:54.996734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:54.997202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:54.997318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:54.997691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:54.998104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:55.002283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:40:55.004706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:55.005260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:55.005696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:55.006397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:55.006850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:55.007271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:55.066223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:55.074094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0e402c58-6ef7-4331-bc8e-6194a9f00be0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096524 Aug 09 12:40:55.074670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 862/1714] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:54 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:55.084280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:55.092152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c69d7f8-84c5-4ca2-9522-7e01371ba7a7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099975 Aug 09 12:40:55.092752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 853/1715] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:54 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:55.319357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:40:55.319701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:40:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:40:56.099702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:56.100992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:56.108696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:56.109183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:56.109615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:56.110311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:56.110761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:56.111183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:56.112218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:56.112855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:56.119759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:56.120250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:56.120715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:56.121408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:56.121861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:56.122341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:56.193748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:56.196677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:56.202454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-80b4c9cf-c1f7-4ea6-8973-1315fcdcd596 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.109161 Aug 09 12:40:56.203018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 863/1716] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:56 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:56.204732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c6e7fc86-de22-41fa-b444-bb97048522e5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096367 Aug 09 12:40:56.205306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 854/1717] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:56 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:40:57.227804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:57.229216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:57.231295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:57.232255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:57.240209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:57.241160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:57.241879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:57.242969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:57.243249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:57.243816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:57.243965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:57.244235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:57.244412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:57.245128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:57.245579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:57.246006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:57.328861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:57.330805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:57.336784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac1de758-e5f4-44a5-b2b5-7392c175e987 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.115396 Aug 09 12:40:57.337456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 864/1718] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:57 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:57.338740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6f7e9e0d-7444-4556-9474-8d07b7454747 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.114440 Aug 09 12:40:57.339308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 855/1719] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:57 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:58.362017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:58.363009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:58.363791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:58.364819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:58.373967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:58.374780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:58.375501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:58.375914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:58.376704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:58.376958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:58.377445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:58.377696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:58.378527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:58.378917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:58.379681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:58.380370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:58.447262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:58.456505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-324f63a1-e71a-4b3c-ab9a-c87cb823102b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098895 Aug 09 12:40:58.457079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 856/1720] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:58 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:58.614863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:58.624594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc6d237a-488d-4068-8657-8a523c7fcf9d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.269141 Aug 09 12:40:58.625173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 865/1721] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:58 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:59.482445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:59.483412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:59.494394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:59.494869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:59.495295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:59.495979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:59.496424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:59.496863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:59.568102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:59.576294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b6444ed3-b029-492e-9574-73559b8eb2e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100323 Aug 09 12:40:59.576929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 857/1722] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:59 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:40:59.649468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:40:59.650393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:40:59.657415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:59.657903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:59.658345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:59.659045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:40:59.659502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:40:59.659923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:40:59.727829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:40:59.736252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-000b566b-e52f-49b6-9165-9538581fce0c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093281 Aug 09 12:40:59.736789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 866/1723] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:40:59 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:00.601337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:00.602323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:00.609797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:00.610282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:00.610714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:00.611415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:00.611853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:00.612301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:00.673598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:00.681479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-111dd972-bf3d-4245-a547-6ca6bf0dbaa5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086765 Aug 09 12:41:00.682051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 858/1724] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:00 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:00.761405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:00.762082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:00.764946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:00.771442 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:00.772001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:00.772527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:00.773346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:00.773878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:00.774375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:00.845651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:00.853861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59e7e88c-642d-4b45-973e-d4bfa5b1f79c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098587 Aug 09 12:41:00.854327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 867/1725] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:00 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:01.706623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:01.707611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:01.716646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:01.717121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:01.717542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:01.718225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:01.718665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:01.719081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:01.788700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:01.796732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3de1e944-40aa-4e6d-bece-9fbe708d73db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096652 Aug 09 12:41:01.797274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 859/1726] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:01 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:01.879776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:01.881441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:01.892446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:01.893278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:01.893993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:01.895123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:01.895868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:01.896591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:01.964992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:01.973058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-90fd3ec7-0477-4da9-bcc7-0b2cf7820949 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100683 Aug 09 12:41:01.973586 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 868/1727] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:01 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:02.821569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:02.822601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:02.829466 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:02.829945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:02.830369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:02.831059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:02.831503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:02.831922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:02.894297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:02.902413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bd1f613b-c63d-4c9b-a0ee-c6cc1ba1a5a2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087363 Aug 09 12:41:02.902970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 860/1728] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:02 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:02.998964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:03.000004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:03.010820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:03.011302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:03.011731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:03.012417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:03.012900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:03.013324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:03.074504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:03.082144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-09e43433-dbf7-473e-a999-4cda094b3ddf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090192 Aug 09 12:41:03.082693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 869/1729] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:02 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:03.926477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:03.927364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:03.930889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:03.937428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:03.937908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:03.938370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:03.939061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:03.939539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:03.939952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:04.001653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:04.009581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e2df8d4c-7e16-46dd-8868-78ed0a1ea6de tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089383 Aug 09 12:41:04.010658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 861/1730] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:03 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:04.108264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:04.109027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:04.119418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:04.119891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:04.120324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:04.121016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:04.121493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:04.121910 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:04.186473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:04.194464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b7160eed-a963-4cfe-bc94-3c59565f9344 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093730 Aug 09 12:41:04.195028 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 870/1731] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:04 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:05.035008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:05.036037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:05.044937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:05.045414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:05.045839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:05.046526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:05.046972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:05.047376 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:05.119180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:05.131182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-447407dd-b813-4feb-ab16-afc7f8d7764a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102509 Aug 09 12:41:05.131981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 862/1732] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:05 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:05.222038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:05.222989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:05.232366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:05.232872 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:05.233307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:05.234003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:05.234457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:05.234878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:05.299652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:05.307908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c793dc1d-3324-4122-803b-0baa01924ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092100 Aug 09 12:41:05.308517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 871/1733] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:05 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:06.154007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:06.154612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:06.161644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:06.162090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:06.162521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:06.163204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:06.163649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:06.164062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:06.231818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:06.239895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e2124d10-57ef-46a3-972c-ea4f279b0cad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090171 Aug 09 12:41:06.240524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 863/1734] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:06 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:06.333490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:06.334472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:06.343243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:06.343727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:06.344161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:06.344891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:06.345340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:06.345763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:06.410969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:06.418868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-781e0f0e-8f0e-4099-b556-d76f63d2eba7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092135 Aug 09 12:41:06.419444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 872/1735] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:06 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:07.261176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:07.261901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:07.268996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:07.269494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:07.269920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:07.270617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:07.271075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:07.271494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:07.350152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:07.359605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5ff1a9fc-18ea-42dd-b3e4-75d0986ac280 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102459 Aug 09 12:41:07.360182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 864/1736] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:07 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:07.447987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:07.451514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:07.458272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:07.458759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:07.459190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:07.459891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:07.460407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:07.460829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:07.534620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:07.543027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-acef5768-c642-4bbd-a20c-f99de4038f40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100410 Aug 09 12:41:07.543865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 873/1737] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:07 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:08.386936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:08.387867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:08.400525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:08.401699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:08.402413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:08.403544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:08.404281 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:08.405013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:08.467474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:08.475922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-af60f13c-2c35-4f63-9732-7c4ea11e87f9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095539 Aug 09 12:41:08.476509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 865/1738] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:08 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:08.568694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:08.569448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:08.580713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:08.581315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:08.581741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:08.582413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:08.582860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:08.583281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:08.655007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:08.665195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52a8db53-a869-4ae5-b70a-49a3890073e7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102729 Aug 09 12:41:08.665749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 874/1739] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:08 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:09.501290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:09.502341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:09.512877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:09.513677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:09.514386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:09.515514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:09.516254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:09.517001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:09.580219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:09.588084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-673e8fe7-0306-438c-a116-0dbdb640c6aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093705 Aug 09 12:41:09.588660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 866/1740] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:09.690913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:09.691555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:09.698675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:09.699194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:09.699656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:09.700407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:09.700903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:09.701350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:09.769686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:09.777463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1d566712-4e3b-43b5-bf4a-a9a645f4143b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.092220 Aug 09 12:41:09.777993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 875/1741] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:09 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:10.611193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:10.612172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:10.620424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:10.621041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:10.621573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:10.622426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:10.623011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:10.623498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:10.687561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:10.695394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ea6b2c1e-cea4-499a-bf5e-6e3d147ebd6f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089284 Aug 09 12:41:10.695953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 867/1742] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:10 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:10.801547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:10.802235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:10.811299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:10.811891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:10.812433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:10.813312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:10.813934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:10.814457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:10.887446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:10.896307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-46b88175-a540-4341-b2a2-ae090a3ecc01 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100415 Aug 09 12:41:10.896906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 876/1743] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:10 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:11.715363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:11.716016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:11.723223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:11.723725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:11.724209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:11.725124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:11.725731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:11.726331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:11.795729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:11.803887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-77b909f8-f90a-4389-b945-b89c78c82abb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092469 Aug 09 12:41:11.804478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 868/1744] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:11 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:11.925467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:11.926107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:11.933057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:11.933547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:11.933985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:11.934680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:11.935128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:11.935551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:12.006474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:12.014366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-24af80ae-cb0a-4b2a-8b62-19bc7f3939e5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093372 Aug 09 12:41:12.014937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 877/1745] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:11 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:12.829066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:12.830824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:12.841189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:12.841976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:12.842681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:12.843805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:12.844601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:12.845420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:12.849624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:12.909367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:12.917074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-733e2144-5cfb-4604-b982-1ac597062b3a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094675 Aug 09 12:41:12.917641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 869/1746] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:12 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:13.039751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:13.040786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:13.050810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:13.051291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:13.051721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:13.052426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:13.052887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:13.053291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:13.128637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:13.132002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:13.136712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b9ab2a84-5bc8-4cdf-8358-b72c7d1267f8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103927 Aug 09 12:41:13.137294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 878/1747] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:13 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:13.940815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:13.941619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:13.950521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:13.951164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:13.951740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:13.952704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:13.953306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:13.953863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:14.018100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:14.025973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2517ac64-5402-49bc-9402-23a0e2f3d836 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091176 Aug 09 12:41:14.026534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 870/1748] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:13 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:14.160926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:14.161527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:14.168193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:14.168710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:14.169151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:14.169850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:14.170311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:14.170741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:14.240598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:14.248297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1750b946-9d2c-4a85-954e-0da3bf169e0a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093024 Aug 09 12:41:14.248900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 879/1749] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:14 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:15.051062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:15.052040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:15.062797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:15.063629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:15.064317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:15.065162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:15.065612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:15.066028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:15.129349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:15.140823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8edf1ff0-3169-4d5f-935d-7b2e26a2314a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096417 Aug 09 12:41:15.141536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 871/1750] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:15 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:15.273139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:15.273821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:15.281544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:15.282071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:15.283074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:15.283536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:15.284034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:15.284533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:15.351809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:15.359453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-28bd74c6-926e-473d-8c71-7e4b925114e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091671 Aug 09 12:41:15.360012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 880/1751] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:15 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:16.171579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:16.172458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:16.179601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:16.180075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:16.180541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:16.181225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:16.181667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:16.182087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:16.250829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:16.259209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-52f08b5c-8246-4db0-b7da-e60b54c022b4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094267 Aug 09 12:41:16.259769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 872/1752] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:16 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:16.384593 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:16.385613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:16.396543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:16.397363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:16.398097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:16.399250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:16.400013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:16.400787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:16.465752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:16.474050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-112266fb-9cf3-47c6-ba73-358a007fd076 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096353 Aug 09 12:41:16.474626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 881/1753] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:16 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:17.284213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:17.284911 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:17.292867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:17.293432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:17.293944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:17.294759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:17.295294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:17.295798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:17.362404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:17.370532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cfd98cab-2916-4c60-a3eb-41a0e8362197 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092621 Aug 09 12:41:17.371099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 873/1754] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:17 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:17.498269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:17.499290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:17.507480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:17.507963 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:17.508415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:17.509125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:17.509580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:17.510004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:17.581923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:17.590119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6c45e17b-c568-4b23-8584-b0d64a78ee6d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098446 Aug 09 12:41:17.590688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 882/1755] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:17 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:18.395669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:18.396710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:18.406201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:18.407177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:18.407872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:18.409047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:18.409653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:18.410215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:18.475235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:18.482995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b1c0d236-37a2-489d-9cac-44cdb733f723 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093791 Aug 09 12:41:18.483563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 874/1756] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:18 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:18.614273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:18.615023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:18.623415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:18.624015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:18.624588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:18.625442 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:18.626006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:18.626655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:18.696622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:18.708446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e46ff9dc-a0b0-4eed-ba61-0fc3e805ccb5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099424 Aug 09 12:41:18.709248 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 883/1757] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:18 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:19.508268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:19.509263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:19.520672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:19.521353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:19.522082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:19.523269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:19.523978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:19.524769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:19.592613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:19.600681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-934c8c72-dc21-4583-9c06-05ecee8bf6f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099852 Aug 09 12:41:19.601260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 875/1758] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:19 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:19.733113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:19.733697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:19.742728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:19.743380 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:19.743935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:19.745004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:19.745637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:19.746219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:19.814454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:19.822378 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83c3ff68-bb02-44dd-8929-2b8f09e35aa0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095436 Aug 09 12:41:19.822940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 884/1759] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:19 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:20.625915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:20.627112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:20.638337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:20.639141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:20.639856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:20.641070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:20.642041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:20.642517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:20.704764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:20.712895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-af36ecde-61f3-4708-995c-d117cb5da1be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093568 Aug 09 12:41:20.713457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 876/1760] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:20 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:20.847808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:20.848823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:20.859881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:20.861008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:20.861455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:20.862158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:20.862615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:20.863041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:20.930312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:20.938245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bdd43a35-4fe7-4ce5-b032-a5fecde8bc7d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097437 Aug 09 12:41:20.938916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 885/1761] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:20 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:21.745578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:21.746470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:21.755536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:21.756013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:21.756465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:21.757151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:21.757599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:21.758012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:21.820329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:21.832453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d4aa4172-b7e8-4cf2-bf57-620e83d9c792 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093239 Aug 09 12:41:21.833206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 877/1762] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:21 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:21.962307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:21.963230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:21.972244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:21.972754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:21.973182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:21.973869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:21.974317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:21.974730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:22.039742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:22.047893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f1a6cd2-b9a9-4591-a8ff-36c211ec1bff tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091288 Aug 09 12:41:22.048649 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 886/1763] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:21 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:22.862006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:22.862871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:22.870678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:22.871240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:22.871737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:22.872579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:22.873098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:22.873588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:22.944614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:22.952518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4917f254-26a8-422f-9923-47cb3007b7db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097008 Aug 09 12:41:22.953091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 878/1764] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:22 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:23.073326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:23.074249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:23.083230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:23.083704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:23.084131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:23.084859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:23.085307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:23.085725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:23.148203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:23.155844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb58a295-c685-4bef-b79a-1e663dc76ae0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089095 Aug 09 12:41:23.156421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 887/1765] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:23 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:23.975833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:23.976662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:23.985390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:23.986043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:23.986839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:23.987759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:23.988371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:23.988959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:24.058038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:24.066348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-304e51a7-4537-4c0f-8d35-2083c2ddc1f1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095690 Aug 09 12:41:24.066922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 879/1766] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:23 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:24.181252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:24.182103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:24.191419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:24.191905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:24.192340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:24.193080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:24.193555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:24.193960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:24.259690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:24.267968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-142e0e0b-96d9-40ac-825a-e19a95d4a7e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093496 Aug 09 12:41:24.268578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 888/1767] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:24 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:25.091110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:25.091988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:25.102974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:25.103762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:25.104477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:25.105689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:25.106429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:25.107118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:25.169858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:25.177601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-854e34b7-589a-4b20-9225-d0c81ccc2ea1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093266 Aug 09 12:41:25.178164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 880/1768] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:25 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:25.293526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:25.294449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:25.303258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:25.303736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:25.304185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:25.304981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:25.305430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:25.305847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:25.376982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:25.385571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8de31b8b-fe4e-47c7-ae93-d6ee938e81b7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098542 Aug 09 12:41:25.386162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 889/1769] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:25 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:26.210395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:26.211270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:26.221887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:26.222361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:26.222808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:26.223498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:26.223944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:26.224354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:26.286191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:26.296064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1fc7bb84-3ed6-481d-a789-24d30872b47d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092659 Aug 09 12:41:26.296870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 881/1770] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:26 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:26.418278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:26.419246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:26.430160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:26.430966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:26.431692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:26.432936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:26.433694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:26.434400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:26.511108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:26.521371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1b31a5e3-675a-45e5-966c-c3af51d0153c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.109686 Aug 09 12:41:26.521970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 890/1771] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:26 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:27.324862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:27.325847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:27.334652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:27.335131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:27.335558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:27.336301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:27.336781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:27.337194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:27.409502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:27.420922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3669c2fb-6af4-4221-86d4-77570506abcb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102407 Aug 09 12:41:27.421752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 882/1772] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:27 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:41:27.547199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:27.548164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:27.558181 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:27.558858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:27.559388 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:27.560319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:27.561002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:27.561556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:27.641334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:27.649339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6db2689b-779c-499a-89d5-5d84630a8a43 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.108927 Aug 09 12:41:27.649906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 891/1773] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:27 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:28.444162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:28.444795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:28.451776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:28.452259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:28.452717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:28.453442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:28.453895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:28.454320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:28.516672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:28.524651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73dc6994-ca7c-4b3b-8f13-f1255bf08d91 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.084726 Aug 09 12:41:28.525224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 883/1774] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:28 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:28.675446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:28.676467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:28.687043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:28.687849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:28.688624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:28.689848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:28.690821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:28.691252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:28.762196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:28.771793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8446a772-e013-47e4-9b26-fcd5bf79f673 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.103744 Aug 09 12:41:28.772402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 892/1775] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:28 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:29.549703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:29.550463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:29.558727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:29.559355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:29.559889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:29.560784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:29.561374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:29.561873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:29.628109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:29.640169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d31ce980-bc1e-40a3-82fa-7259bf92c9e8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.096775 Aug 09 12:41:29.641005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 884/1776] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:29 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:29.795478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:29.796288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:29.803990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:29.804408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:29.804861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:29.805548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:29.806101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:29.806518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:29.879291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:29.887767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0d3d485e-9e1e-4d7b-bb97-a20d652a1e60 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097167 Aug 09 12:41:29.888349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 893/1777] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:29 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:30.666272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:30.667374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:30.678657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:30.679403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:30.680107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:30.681301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:30.682042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:30.682736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:30.747293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:30.752567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:30.758039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-11b1572d-8adf-4fd4-ac07-4629ad9b82d0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098663 Aug 09 12:41:30.758584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 885/1778] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:30 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:30.911969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:30.912626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:30.915051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:30.920289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:30.920751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:30.921191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:30.921886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:30.922337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:30.922757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:30.987138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:30.994705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-807502a8-3212-4711-8311-1686f436208c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087622 Aug 09 12:41:30.995272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 894/1779] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:30 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:31.782392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:31.783027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:31.793236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:31.793833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:31.794417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:31.795342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:31.795986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:31.796652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:31.858970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:31.866787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-495c2fb5-6d8c-4bfd-a7ea-c971af59e393 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091056 Aug 09 12:41:31.867346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 886/1780] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:31 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:32.019285 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:32.019973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:32.027887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:32.028493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:32.029039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:32.029854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:32.030388 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:32.030889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:32.051819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:32.101735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:32.113421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a197a067-e887-4a1c-9ced-d0b73fc8ab84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.100331 Aug 09 12:41:32.114300 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 895/1781] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:32 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:32.898141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:32.899139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:32.909838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:32.910316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:32.910740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:32.911431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:32.911873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:32.912291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:32.974988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:32.985979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-93c514c8-05f9-4a6f-9bda-0f63cdfeb1f8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095777 Aug 09 12:41:32.986718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 887/1782] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:32 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:33.144239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:33.145161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:33.156098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:33.156974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:33.157707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:33.158857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:33.159576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:33.159921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:33.225826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:33.237599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c5fd0df1-913e-4309-a2e0-3e794245f33d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099731 Aug 09 12:41:33.238253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 896/1783] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:33 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:34.011925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:34.013064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:34.016653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:34.022970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:34.023445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:34.023872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:34.024591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:34.025034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:34.025449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:34.095788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:34.103744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-935fda42-04aa-430f-ad24-6d01492dae44 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099076 Aug 09 12:41:34.104313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 888/1784] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:34 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:34.262505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:34.263369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:34.272109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:34.272632 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:34.273061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:34.273748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:34.274194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:34.274611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:34.340875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:34.348997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db2d4280-4a47-4e1f-805a-2108bb664dee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093142 Aug 09 12:41:34.349556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 897/1785] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:34 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:35.129075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:35.129669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:35.136495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:35.137006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:35.137434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:35.138138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:35.138558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:35.138969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:35.204773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:35.212767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-265c1acc-9429-497b-a63a-a93b7c84ead8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090617 Aug 09 12:41:35.213339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 889/1786] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:35 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:35.373372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:35.373958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:35.382575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:35.383044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:35.383467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:35.384186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:35.384665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:35.385094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:35.453634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:35.461831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1bf82353-a4fd-4259-b5ad-c2c783f60022 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094789 Aug 09 12:41:35.462418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 898/1787] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:35 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:36.234137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:36.234747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:36.242676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:36.243166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:36.243605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:36.244308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:36.244798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:36.245231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:36.315796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:36.323796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4da88124-3002-4362-acd4-3466f3f16679 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093732 Aug 09 12:41:36.324367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 890/1788] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:36 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:36.487863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:36.488469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:36.498098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:36.498946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:36.499694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:36.500927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:36.501707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:36.502385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:36.572338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:36.580153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c46db66d-fe03-4ae0-b973-4130d80dd494 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098944 Aug 09 12:41:36.580837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 899/1789] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:36 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:37.348287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:37.348950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:37.355755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:37.356237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:37.356703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:37.357393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:37.357843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:37.358284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:37.420193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:37.428097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dca42ed2-19bf-4df6-8c21-a1e8cc71e98d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.085419 Aug 09 12:41:37.428705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 891/1790] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:37 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:37.606045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:37.606916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:37.616920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:37.617718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:37.618409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:37.619570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:37.620323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:37.621062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:37.687805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:37.695590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-31d9c70b-f242-4467-b8ee-16a85cab200b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096628 Aug 09 12:41:37.696151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 900/1791] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:37 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:38.449300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:38.449891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:38.456961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:38.457435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:38.457861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:38.458546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:38.458995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:38.459437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:38.531948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:38.540396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bab942e2-056e-498c-b757-055eb1d2826e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094997 Aug 09 12:41:38.540960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 892/1792] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:38 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:38.723249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:38.724349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:38.734842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:38.735619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:38.736406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:38.737458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:38.737979 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:38.738439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:38.801445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:38.809278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3769f8af-c6ec-4264-b913-71ebd8af127b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.093860 Aug 09 12:41:38.809845 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 901/1793] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:38 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:39.564734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:39.565768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:39.573670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:39.574155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:39.574591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:39.575291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:39.575742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:39.576177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:39.637914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:39.645912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6aba5159-6497-418c-a4d0-078b0aeda739 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087762 Aug 09 12:41:39.646469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 893/1794] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:39 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:39.840144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:39.841226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:39.851874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:39.852361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:39.852823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:39.853521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:39.853976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:39.854399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:39.923021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:39.932402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-db169b16-6761-4f8b-9379-5747ac26d515 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099954 Aug 09 12:41:39.932982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 902/1795] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:39 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:40.671231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:40.672206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:40.681161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:40.681645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:40.682081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:40.682780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:40.683231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:40.683653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:40.752840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:40.761450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4698e866-b6af-45d4-b364-85683584a244 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097028 Aug 09 12:41:40.762028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 894/1796] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:40 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:40.957689 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:40.958653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:40.965573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:40.966063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:40.966500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:40.967202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:40.967659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:40.968086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:41.037221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:41.045967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd6d25d8-d7a4-4507-9a48-900352360a89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.095053 Aug 09 12:41:41.046537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 903/1797] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:40 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:41.786127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:41.787252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:41.793990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:41.794469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:41.795162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:41.796179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:41.796662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:41.797076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:41.867894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:41.875983 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a7eebd54-de3a-486a-9157-0da80ed9f2f3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093872 Aug 09 12:41:41.876598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 895/1798] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:41 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:42.067604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:42.068521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:42.075038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:42.075521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:42.075955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:42.076686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:42.077137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:42.077568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:42.142962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:42.150973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-66ada4cb-ff54-4c04-9bfb-95b3f19d76c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087438 Aug 09 12:41:42.151529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 904/1799] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:42 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:42.899027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:42.899719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:42.906329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:42.906805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:42.907231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:42.907914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:42.908357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:42.908794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:42.977332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:42.985092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e07353f3-a3a3-46bb-90ed-301c5d201cb8 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090957 Aug 09 12:41:42.985649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 896/1800] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:42 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:43.176508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:43.177621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:43.184273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:43.184790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:43.185225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:43.185920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:43.186371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:43.186790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:43.255824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:43.263814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47860903-f58e-43b7-a782-6a5cb587aa18 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094112 Aug 09 12:41:43.264404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 905/1801] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:43 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:44.010552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:44.011127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:44.018155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:44.018649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:44.019087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:44.019797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:44.020251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:44.020712 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:44.095559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:44.107147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-584bb1e2-34f1-4ed9-82ff-5caa4929085c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102503 Aug 09 12:41:44.107961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 897/1802] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:44 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:44.288576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:44.289292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:44.297558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:44.298156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:44.298700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:44.299556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:44.300123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:44.300703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:44.371750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:44.384282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-30f81d35-fe12-45f2-90be-bda84006ddaf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.102018 Aug 09 12:41:44.385101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 906/1803] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:44 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:45.138743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:45.139742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:45.149684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:45.150163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:45.150589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:45.151272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:45.151717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:45.152119 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:45.219351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:45.228031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5307091f-c9bc-4644-a569-4510e22b306f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095919 Aug 09 12:41:45.228641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 898/1804] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:45 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:45.414069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:45.414935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:45.425379 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:45.426138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:45.426827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:45.427915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:45.428701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:45.429304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:45.490655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:45.499138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b483d205-78e0-4875-9183-c046fc1b0cf5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091644 Aug 09 12:41:45.499713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 907/1805] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:45 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:46.253930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:46.254973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:46.262879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:46.263363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:46.263790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:46.264520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:46.264971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:46.265386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:46.330218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:46.338449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cc2898e9-21c1-4498-ab31-28a2c2e29b7d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.091625 Aug 09 12:41:46.339012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 899/1806] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:46 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:46.521090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:46.521672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:46.528850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:46.529344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:46.529792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:46.530580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:46.531096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:46.531626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:46.598516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:46.606674 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c54da67-22d8-4f83-912d-0ee6f170f5b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089696 Aug 09 12:41:46.607249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 908/1807] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:46 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:47.364099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:47.365114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:47.373128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:47.373618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:47.374037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:47.374720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:47.375167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:47.375586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:47.442547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:47.450719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8d22952c-f453-4822-8f11-0522a0329a41 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093539 Aug 09 12:41:47.451289 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 900/1808] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:47 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:47.635659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:47.636263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:47.643670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:47.644190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:47.644738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:47.645497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:47.645994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:47.646455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:47.709401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:47.717295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7214d91e-cb3c-4100-b92f-3d3a244a407f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.087556 Aug 09 12:41:47.717871 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 909/1809] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:47 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:48.472095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:48.472813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:48.480184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:48.480702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:48.481142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:48.481831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:48.482272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:48.482695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:48.550660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:48.561555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-136208e5-1f26-4db1-9794-97d03046e8ad tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093562 Aug 09 12:41:48.562430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 901/1810] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:48 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:48.738869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:48.739432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:48.746877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:48.747355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:48.747787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:48.748517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:48.748968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:48.749370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:48.813007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:48.820911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b49d5c81-77dc-4a39-af9c-8de26e2efcdb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.086115 Aug 09 12:41:48.821474 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 910/1811] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:48 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:49.587253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:49.588213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:49.595410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:49.595892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:49.596321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:49.597040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:49.597493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:49.597912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:49.615864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:49.662149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:49.669970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1eae42ae-cb9b-49f1-b55f-c108ae9cf5ee tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089351 Aug 09 12:41:49.670538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 902/1812] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:49 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:49.847004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:49.847928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:49.857963 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:49.858447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:49.858879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:49.859599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:49.860028 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:49.860484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:49.929275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:49.937080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b2428ff2-c92b-422d-b099-b673962f182a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.097357 Aug 09 12:41:49.937623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 911/1813] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:49 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:50.695113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:50.696102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:50.703670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:50.704144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:50.704609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:50.705298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:50.705744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:50.706158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:50.777903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:50.785914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-82cacfaf-06b3-4873-b64e-6883f83b3641 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097373 Aug 09 12:41:50.786484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 903/1814] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:50 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:50.965247 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:50.965810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:50.972750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:50.973237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:50.973675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:50.974374 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:50.974830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:50.975240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:50.979267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:51.040326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:51.048358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4fd0470d-6c3a-4358-8df4-28e83f2f59ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.089001 Aug 09 12:41:51.048958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 912/1815] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:50 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:51.807979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:51.808647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:51.815483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:51.815962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:51.816397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:51.817096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:51.817534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:51.817948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:51.880003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:51.888176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-eb8fd8af-a206-4948-8e11-7cc2bd4df51c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.084637 Aug 09 12:41:51.888756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 904/1816] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:51 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:52.075669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:52.076234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:52.083310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:52.083825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:52.084282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:52.085037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:52.085517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:52.085958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:52.155496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:52.163633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-25af3932-021c-428a-83c4-a0c20080f208 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.096006 Aug 09 12:41:52.164206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 913/1817] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:52 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:52.909411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:52.910021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:52.917241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:52.917470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:52.917924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:52.918614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:52.919064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:52.919484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:52.983393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:52.991514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ff5225bc-986b-40f0-a3f9-e0fdefd9e478 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.086103 Aug 09 12:41:52.992085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 905/1818] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:52 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:53.188271 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:53.189073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:53.197875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:53.198525 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:53.199391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:53.200773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:53.201387 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:53.201952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:53.268643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:53.276791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7bff132b-13a0-4983-8deb-70467370faed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094129 Aug 09 12:41:53.277365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 914/1819] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:53 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:54.017576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:54.018549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:54.028296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:54.028813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:54.029253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:54.029943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:54.030391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:54.030818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:54.093286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:54.101344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-83e3c0aa-d34e-4506-ae33-706b97e0c616 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090309 Aug 09 12:41:54.101944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 906/1820] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:54 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:54.301625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:54.302605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:54.313533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:54.314341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:54.315080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:54.316214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:54.317019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:54.317731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:54.384057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:54.393201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7e6c872b-e3dc-4678-8921-5e01c0c9d2a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.098254 Aug 09 12:41:54.393765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 915/1821] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:54 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:55.126822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:55.127797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:55.138685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:55.139307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:55.139900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:55.140988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:55.141642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:55.142178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:55.214648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:55.222569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-33b36351-9c1e-4448-98bc-4c8b77786a67 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102434 Aug 09 12:41:55.223140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 907/1822] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:55 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:55.420170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:55.421142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:55.431643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:55.432320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:55.432933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:55.434334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:55.435818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:55.435818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:55.522745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:55.530942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa967e33-eb3a-4c52-af3b-65ee183a1237 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.118477 Aug 09 12:41:55.531516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 916/1823] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:55 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:56.246974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:56.247578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:56.254907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:56.255388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:56.255839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:56.256585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:56.257029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:56.257473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:56.324130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:56.332041 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8d18ee06-c0d5-4c7e-b3fc-64139c9d6103 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090894 Aug 09 12:41:56.332638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 908/1824] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:56 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:56.555959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:56.556726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:56.567059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:56.567853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:56.568594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:56.569713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:56.570436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:56.571051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:56.739083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:56.746985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1b4afcf4-3673-4c29-956b-64097934f66d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.197743 Aug 09 12:41:56.747568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 917/1825] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:56 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:57.357732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:57.358832 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:57.369805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:57.370592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:57.371369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:57.372537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:57.373280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:57.373977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:57.444128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:57.451927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f9462455-5c10-4ff5-8de1-9fb0507f296a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101282 Aug 09 12:41:57.452509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 909/1826] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:57 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:57.771609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:57.772614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:57.780931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:57.781422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:57.781853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:57.782549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:57.783002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:57.783401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:57.856204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:57.864637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-566532c5-7022-4b7c-9cc2-f7cfe18423a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.099605 Aug 09 12:41:57.865195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 918/1827] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:57 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:58.473012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:58.473729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:58.480721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:58.481176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:58.481604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:58.482274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:58.482718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:58.483129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:58.598852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:58.609167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-644aa419-8482-459c-91b2-c3d0bff61757 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.140145 Aug 09 12:41:58.609739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 910/1828] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:58 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:58.888808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:58.889431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:58.896284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:58.896804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:58.897237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:58.897944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:58.898391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:58.898794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:58.960167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:58.968289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-18739614-5ed4-4801-9cfa-88c80d4fc6c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.084396 Aug 09 12:41:58.968898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 919/1829] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:58 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:59.634852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:59.635903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:41:59.642772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:59.643250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:59.643678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:59.644366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:41:59.644837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:41:59.645257 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:41:59.715610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:41:59.725667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b9976d3e-fddc-426c-b841-077e58d662aa tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097475 Aug 09 12:41:59.726393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 911/1830] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:59 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:41:59.993669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:41:59.994678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:00.001800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:00.002303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:00.002736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:00.003767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:00.004208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:00.004662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:00.069810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:00.078758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-63eae2cc-beb9-471d-afe7-493f388f56d3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.091712 Aug 09 12:42:00.079326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 920/1831] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:41:59 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:00.751248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:00.752207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:00.763476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:00.764255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:00.765048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:00.766187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:00.766939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:00.767638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:00.834398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:00.844350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-41f5e2fe-77e7-4db4-a706-41250fe6215d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099875 Aug 09 12:42:00.844956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 912/1832] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:00 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:01.103631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:01.104579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:01.106954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:01.112479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:01.112912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:01.113350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:01.114062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:01.114515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:01.114928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:01.179873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:01.187695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c23062bc-5960-4731-aa18-b1e164ebf391 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.090864 Aug 09 12:42:01.188275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 921/1833] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:01 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:01.868606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:01.869654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:01.881913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:01.882716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:01.883427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:01.884614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:01.885480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:01.886443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:01.949094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:01.957006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b17a0321-8ed4-4eb2-a815-4bb735de728d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094997 Aug 09 12:42:01.957576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 913/1834] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:01 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:02.212346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:02.213210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:02.220315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:02.220826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:02.221254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:02.221945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:02.222391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:02.222804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:02.287757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:02.300565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2dc6a0c7-564b-426b-bd46-ae7f7a12dd52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091" status: 200 len: 1225 microversion: 2.1 time: 0.094257 Aug 09 12:42:02.301459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 922/1835] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:02 2022] GET /compute/v2.1/servers/f3a3ffd4-5a06-4bf5-8d68-1bb06ddcd091 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:02.983405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:02.984446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:02.995815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:02.996296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:02.996779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:02.997454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:02.997895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:02.998325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:03.066407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:03.075851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2815c992-806e-4654-a15e-d6999ccdc642 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099827 Aug 09 12:42:03.076560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 914/1836] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:02 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:04.101506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:04.102458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:04.111180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:04.111655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:04.112083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:04.112804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:04.113255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:04.113664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:04.177923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:04.185704 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a1f2b19-ecae-4d1a-8c09-c95fd99a5ac5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090799 Aug 09 12:42:04.186260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 923/1837] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:04 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:05.210078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:05.210899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:05.214434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:05.220204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:05.220718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:05.221156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:05.221852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:05.222304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:05.222732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:05.292647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:05.304412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-53aac8c8-e5dc-4bf6-a026-13ce3fe61862 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100343 Aug 09 12:42:05.305144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 915/1838] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:05 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:06.331954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:06.332983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:06.343912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:06.344788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:06.345569 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:06.346727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:06.347489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:06.348201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:06.419633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:06.427446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea3def74-110a-4d0c-adf1-1e22f49883e0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102209 Aug 09 12:42:06.428016 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 924/1839] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:06 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:07.535709 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:07.536908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:07.544072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:07.544870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:07.545316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:07.546020 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:07.546474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:07.546894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:07.623831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:07.636271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5b98824a-73f0-4ef1-815e-0b2f8be5cc8d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.191603 Aug 09 12:42:07.637295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 916/1840] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:07 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:08.667838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:08.668865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:08.679796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:08.681364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:08.681668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:08.683464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:08.684852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:08.686154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:08.751149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:08.759334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-11cee027-5185-4000-bdc6-161b568691e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097935 Aug 09 12:42:08.759906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 925/1841] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:08 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:09.788019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:09.789060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:09.798597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:09.799077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:09.799525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:09.800214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:09.800688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:09.801105 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:09.870842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:09.879140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f2248e29-3319-4b36-9499-4909c03219db tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097802 Aug 09 12:42:09.879702 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 917/1842] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:09 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:10.900651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:10.901402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:10.908908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:10.909405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:10.909836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:10.910524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:10.910969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:10.911384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:10.977942 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:10.990845 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e46a637d-2492-4482-bafa-bee90d8e0487 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094659 Aug 09 12:42:10.991656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 926/1843] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:10 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:12.017140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:12.017720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:12.024757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:12.025214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:12.025669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:12.026359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:12.026814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:12.027244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:12.089325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:12.097379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-69b4596d-c44e-49b0-8c53-ee309c956e05 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.085016 Aug 09 12:42:12.097958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 918/1844] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:12 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:12.246315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:42:12.246924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:42:13.122419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:13.123457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:13.135353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:13.136190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:13.137042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:13.138192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:13.139112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:13.140086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:13.208983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:13.217382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-14fa0b8e-be20-4a22-8f4c-a4ed291df36e tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101675 Aug 09 12:42:13.217919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 927/1845] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:13 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:14.240949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:14.241700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:14.250291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:14.250776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:14.251212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:14.251908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:14.252361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:14.252816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:14.257166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:14.321088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:14.329156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b622faa2-b4c0-4e1c-a027-0d8afee53283 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093632 Aug 09 12:42:14.329734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 919/1846] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:14 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:15.354716 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:15.355852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:15.363809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:15.364291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:15.364757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:15.365437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:15.365890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:15.366310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:15.432369 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:15.435842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:15.440504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-02c13b08-7f8d-49f2-9d0c-e469eec5f5f7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092452 Aug 09 12:42:15.441068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 928/1847] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:15 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:16.465495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:16.466613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:16.474140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:16.474623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:16.475055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:16.475744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:16.476195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:16.476658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:16.537971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:16.546248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-71e1aaec-8b33-4691-9ba6-adc179e840e3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087213 Aug 09 12:42:16.546859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 920/1848] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:16 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:17.575831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:17.576476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:17.583693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:17.584177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:17.584659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:17.585357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:17.585806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:17.586199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:17.648964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:17.656836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56dc37e5-8655-4a6a-9897-3670805f26c9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.084875 Aug 09 12:42:17.657400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 929/1849] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:17 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:18.680924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:18.681708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:18.690162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:18.690646 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:18.691104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:18.691798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:18.692244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:18.692687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:18.757093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:18.765395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-66fe198b-27d7-48d6-9ff1-890aa664d1d5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090580 Aug 09 12:42:18.765908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 921/1850] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:18 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:19.790199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:19.791296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:19.800792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:19.801289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:19.801702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:19.802412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:19.802971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:19.803392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:19.870461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:19.878297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-df861d0d-d83a-435d-ad74-f53a0721044d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094781 Aug 09 12:42:19.879215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 930/1851] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:19 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:20.903680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:20.904768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:20.913333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:20.913809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:20.914213 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:20.914919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:20.915361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:20.915780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:20.976792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:20.984535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ee602ad-0ec2-4d0f-a79b-f162498da5cc tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087287 Aug 09 12:42:20.985021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 922/1852] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:20 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:22.010130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:22.011121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:22.020777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:22.021260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:22.021688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:22.022373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:22.022824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:22.023239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:22.090286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:22.098124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e1766f36-f4ac-47c1-95dd-4a5f43551239 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094976 Aug 09 12:42:22.098676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 931/1853] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:22 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:23.123374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:23.124400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:23.132870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:23.133349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:23.133770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:23.134455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:23.134920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:23.135312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:23.196795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:23.204670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6af5b5e-f987-4fac-97b5-eab32ec17227 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087929 Aug 09 12:42:23.205228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 923/1854] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:23 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:24.233914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:24.234915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:24.243918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:24.244523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:24.245025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:24.245848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:24.246354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:24.246852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:24.312228 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:24.321286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-50e6519a-5dec-4632-a04b-3a30c8c5fda2 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095884 Aug 09 12:42:24.321852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 932/1855] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:24 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:25.346310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:25.347543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:25.355118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:25.355648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:25.356126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:25.356921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:25.357415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:25.357880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:25.425050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:25.433302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-055d5a49-92f2-46d7-b1cf-89dcbf47f13d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093707 Aug 09 12:42:25.433883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 924/1856] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:25 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:26.458284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:26.458935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:26.466022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:26.466522 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:26.466971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:26.467689 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:26.468157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:26.468631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:26.545262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:26.557352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2f1f199-d5c7-408a-beec-ae825a5d3566 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.105134 Aug 09 12:42:26.558107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 933/1857] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:26 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:27.585452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:27.586201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:27.596843 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:27.597523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:27.597967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:27.598690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:27.599148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:27.599569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:27.667585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:27.678348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8c023a54-81de-4ea8-95ef-abc77eedc073 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099849 Aug 09 12:42:27.678920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 925/1858] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:27 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:27.914089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:42:27.914302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:42:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:42:28.703936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:28.704982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:28.712803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:28.713315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:28.713751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:28.714454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:28.714896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:28.715318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:28.777638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:28.785414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3627eea7-edef-433c-845a-8ab044fe1610 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088052 Aug 09 12:42:28.785993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 934/1859] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:28 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:29.810313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:29.811353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:29.820416 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:29.820903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:29.821327 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:29.822012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:29.822452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:29.822865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:29.890364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:29.899315 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a1a86a87-ffd9-4404-b522-ecc55a05189c tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.095475 Aug 09 12:42:29.900105 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 926/1860] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:29 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:30.920903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:30.921465 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:30.929113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:30.929600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:30.930033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:30.930735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:30.931183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:30.931608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:31.001908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:31.014558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7910aba6-1764-4b1a-9318-515fe66460b7 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097370 Aug 09 12:42:31.015460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 935/1861] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:30 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:32.047302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:32.048259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:32.059234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:32.060024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:32.060803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:32.061954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:32.062692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:32.063384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:32.126537 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:32.134813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f0e40647-84eb-4309-8606-1c054dd7fcc4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094071 Aug 09 12:42:32.135379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 927/1862] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:32 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:33.163465 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:33.164439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:33.167922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=30 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:33.176766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:33.177239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:33.177676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:33.178422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:33.178877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:33.179301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:33.246163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:33.255132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a7d5cde-92e2-41c6-8ac9-14156f78b044 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098585 Aug 09 12:42:33.255702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 936/1863] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:33 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:34.280424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:34.281395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:34.289554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:34.290031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:34.290462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:34.291187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:34.291636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:34.292054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:34.363450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:34.371292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7cce5e12-20c9-4750-af73-0c7079052ed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.097504 Aug 09 12:42:34.372229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 928/1864] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:34 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:35.397803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:35.398477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:35.407347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:35.407972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:35.408567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:35.409472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:35.410105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:35.410695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:35.482134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:35.490106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-254f750c-ec2c-4caa-a217-c657b6c669d4 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098501 Aug 09 12:42:35.490657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 937/1865] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:35 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:36.515048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:36.515983 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:36.519904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=28 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:36.528648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:36.529453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:36.530168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:36.531308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:36.532064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:36.532862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:36.869892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:36.882128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-427aff7f-c90e-4909-aeb1-0d74189fb33f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.373478 Aug 09 12:42:36.882956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 929/1866] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:36 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:37.905446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:37.906400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:37.914155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:37.914631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:37.915054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:37.915710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:37.916185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:37.916680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:37.978360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:37.986255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-41583bb2-2881-42b7-b322-06794be077be tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087172 Aug 09 12:42:37.986814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 938/1867] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:37 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:39.012431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:39.013349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:39.023228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:39.023711 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:39.024146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:39.024884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:39.025333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:39.025752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:39.086571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:39.094293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f141f3d5-3cf5-4cf9-99bd-7ed433d259e6 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088545 Aug 09 12:42:39.094851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 930/1868] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:39 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:40.119491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:40.120487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:40.130969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:40.131449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:40.131843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:40.132596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:40.133043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:40.133458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:40.203316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:40.212262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad3c1060-bbef-4e51-98ac-51a2c79ffab5 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.099441 Aug 09 12:42:40.212851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 939/1869] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:40 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:41.237047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:41.237620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:41.244950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:41.245428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:41.245861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:41.246534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:41.246977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:41.247422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:41.317331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:41.325295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7cd3416b-4d30-48d5-9749-49a8f877b023 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094970 Aug 09 12:42:41.325880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 931/1870] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:41 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:42.350226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:42.350866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:42.360185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:42.360857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:42.361452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:42.362500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:42.363131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:42.363768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:42.429865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:42.438049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a41a02a-4cde-4faf-8ca2-8ce149e79709 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094178 Aug 09 12:42:42.438609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 940/1871] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:42 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:43.461485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:43.462173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:43.469591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:43.470122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:43.470597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:43.471358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:43.471860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:43.472321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:43.537112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:43.545084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73b2991a-732b-4b9c-9bb5-f6b62a93a46b tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088939 Aug 09 12:42:43.545641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 932/1872] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:43 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:44.569954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:44.570714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:44.579122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:44.579728 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:44.580265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:44.581155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:44.581714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:44.582242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:44.649032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:44.656675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2c2ebf2-662a-4cef-b538-9df810e504ea tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092880 Aug 09 12:42:44.657240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 941/1873] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:44 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:45.678224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:45.678852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:45.685698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:45.686182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:45.686618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:45.687312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:45.687767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:45.688200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:45.690771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=83 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:45.753428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:45.762152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4321c216-789c-4c28-8c80-b9fde339d00f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.088155 Aug 09 12:42:45.762718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 933/1874] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:45 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:46.782792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:46.783382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:46.791066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:46.791548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:46.791984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:46.792720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:46.793182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:46.793603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:46.873277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:46.881490 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-741b8a21-3886-47df-a9e4-68d9b2167266 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.102761 Aug 09 12:42:46.882094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 942/1875] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:46 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:47.903716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:47.904329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:47.911551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:47.912052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:47.912509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:47.913206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:47.913665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:47.914079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:47.979501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:47.987403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7ffd24bf-9b74-4193-a462-1d2d4d2465a3 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087736 Aug 09 12:42:47.987974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 934/1876] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:47 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:49.013744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:49.014723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:49.026255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:49.027036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:49.027747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:49.028930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:49.029675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:49.030366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:49.034605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=85 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:49.097129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:49.105247 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f05ddb5-6a98-47eb-b73f-0e83712f918f tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.098886 Aug 09 12:42:49.105812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 943/1877] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:49 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:50.130641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:50.131804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:50.142498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:50.143206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:50.143896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:50.145083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:50.145839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:50.146621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:50.221912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:50.230194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-312f83dd-5e04-461b-a9be-c11ddbd15d01 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.106566 Aug 09 12:42:50.230765 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 935/1878] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:50 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:51.256345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:51.257026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:51.263736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:51.264224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:51.264684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:51.265384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:51.265841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:51.266264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:51.335438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:51.343534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8abf2621-0e48-4e0d-82f7-99c5d5f34598 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094119 Aug 09 12:42:51.344106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 944/1879] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:51 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:52.367921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:52.368894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:52.380154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:52.380960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:52.381700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:52.382975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:52.383720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:52.384413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:52.453196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:52.461672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1b6d9219-3873-475b-80d8-2412f919385d tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100427 Aug 09 12:42:52.462262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 936/1880] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:52 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:53.486499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:53.487433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:53.498124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:53.498913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:53.499623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:53.500902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:53.501652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:53.502348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:53.575325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:53.583038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5531e903-4772-46e2-9e54-6532738e0e93 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.103174 Aug 09 12:42:53.583598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 945/1881] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:53 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:54.608208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:54.609266 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:54.618487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:54.619004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:54.619434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:54.620126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:54.620622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:54.621044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:54.692733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:54.703205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-27f586d0-181f-4b9b-9080-b3496c3a6c82 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.101768 Aug 09 12:42:54.703778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 937/1882] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:54 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:55.728873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:55.729596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:55.737049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:55.737638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:55.738216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:55.738977 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:55.739473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:55.739934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:55.804183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:55.815909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-86064d67-143d-4997-b244-5610d27fd3b0 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.092084 Aug 09 12:42:55.816736 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 946/1883] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:55 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:56.841455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:56.842372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:56.852729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:56.853470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:56.854132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:56.855188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:56.855888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:56.856578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:56.921879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:56.929727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-20b888e5-8b69-4938-8900-52591e762d32 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094528 Aug 09 12:42:56.930301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 938/1884] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:56 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:57.950886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:57.951488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:57.958591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:57.959068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:57.959498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:57.960180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:57.960656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:57.961073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:58.023069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:58.031067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eef176e8-0f66-473c-b2ae-dba0ed251b84 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.084226 Aug 09 12:42:58.031720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 947/1885] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:57 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:42:59.056935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:42:59.057582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:42:59.065335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:59.065916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:59.066397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:59.067172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:42:59.067682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:42:59.068155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:42:59.139292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:42:59.150764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-be865837-15a9-48d4-857b-93b6ed09e10a tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.100379 Aug 09 12:42:59.151336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 939/1886] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:42:59 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:00.173541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:00.174149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:00.181518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:00.182023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:00.182475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:00.183194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:00.183665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:00.184099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:00.251857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:43:00.260029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-06029a34-f33b-4751-a4a8-21f5672ff3ed tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.090730 Aug 09 12:43:00.260611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 948/1887] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:43:00 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:01.282495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:01.283100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:01.289913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:01.290390 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:01.290866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:01.291586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:01.292039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:01.292470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:01.353652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:43:01.361584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6a4904b0-3ef8-48e2-b1b3-6d2d6cfe6146 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.083095 Aug 09 12:43:01.362147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 940/1888] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:43:01 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:02.387101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:02.387792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:02.394727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:02.395207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:02.395636 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:02.396323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:02.396806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:02.397221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:02.462273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:43:02.475287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dbc21192-d07e-41b6-8808-7765039b1b09 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.094533 Aug 09 12:43:02.476128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 949/1889] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:43:02 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:03.501875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:03.502871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:03.514268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:03.515051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:03.515760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:03.516923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:03.517663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:03.518355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:03.591489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:43:03.599640 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce3b0d22-5f6d-4178-912e-3f452d2c5d06 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.104449 Aug 09 12:43:03.600211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 941/1890] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:43:03 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:04.630652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:04.631614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:04.635283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=28 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:04.642231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:04.642709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:04.643145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:04.643842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:04.644295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:04.644748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:04.709250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:43:04.716916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20b4c3f6-a909-4ece-8903-89eafa3dc2eb tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.093243 Aug 09 12:43:04.717487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 950/1891] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:43:04 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:05.743217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:05.743856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:05.750719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:05.751191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:05.751622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:05.752307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:05.752781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:05.753198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:05.815641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:43:05.826828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9085d4e3-e6a9-4e23-886e-d922d29daed9 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.087489 Aug 09 12:43:05.827608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 942/1892] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:43:05 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:06.853266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:06.853940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:06.861018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:06.861498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:06.861934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:06.862623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:06.863078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:06.863496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:06.949459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:43:06.960318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2bfe6c7-9e54-4ef4-b213-c3353d1b4dd1 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.111007 Aug 09 12:43:06.961123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 951/1893] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:43:06 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:07.992268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:07.992912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] [instance: a368964e-2b12-4ec7-a757-4cf2796910ab] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:07.995201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=28 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:08.000667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:08.001141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:08.001570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:08.002256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:08.002699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:08.003114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:08.070335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72593249ee4843e9bb3ae413bfccf8b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3caeb344224a6b9ead2052d0b44909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:43:08.071883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:08.072911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:43:08.078226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f5ceeb59-c1e2-4c80-b778-7f8d049c9c83 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab" status: 200 len: 1219 microversion: 2.1 time: 0.089797 Aug 09 12:43:08.080478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:08.080949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:08.081654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:08.082347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:43:08.082986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:43:08.083399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:43:08.092686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 943/1894] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:43:07 2022] GET /compute/v2.1/servers/a368964e-2b12-4ec7-a757-4cf2796910ab => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:43:08.259130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-34e151f0-0506-467f-abe6-252912f44893 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] Calling method '.version_select at 0x7f0e081b6c10>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:43:08.283137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-34e151f0-0506-467f-abe6-252912f44893 tempest-TestShelveInstance-392269447 tempest-TestShelveInstance-392269447-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1775770115" status: 202 len: 0 microversion: 2.1 time: 0.027839 Aug 09 12:43:08.283890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 944/1895] 10.222.0.60 () {58 vars in 1254 bytes} [Tue Aug 9 12:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1775770115 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 12:43:14.903155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lazy-loading 'services' on Instance uuid 6409e8d1-b827-4649-83ea-b853a1f203ff {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:43:18.078587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=5 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:24.924202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=61 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:50.145903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:43:50.147147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b (ip 10.222.0.60) !!! Aug 09 12:43:51.950973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:43:51.951770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:43:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:44:08.132016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=65 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:44:08.132803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:44:08.375018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:44:08.375512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:44:08.385766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:44:08.386569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:44:08.387294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:44:08.388446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:44:08.389221 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:44:08.389944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:44:15.333875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:44:15.335009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:44:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b (ip 10.222.0.60) !!! Aug 09 12:44:18.379960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:44:18.409234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=4 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:45:08.204982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cbec44fe-f891-4c32-9cfe-f0b7797d3882 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b" status: 202 len: 0 microversion: 2.1 time: 120.136869 Aug 09 12:45:08.205826 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 952/1896] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:43:08 2022] DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b => generated 0 bytes in 120139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 12:45:08.212187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:45:08.212805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:45:08.220270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:45:08.220804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:45:08.221353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:45:08.222265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:45:08.222801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:45:08.223222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:45:08.298107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lazy-loading 'services' on Instance uuid 6409e8d1-b827-4649-83ea-b853a1f203ff {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:45:14.979472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lazy-loading 'services' on Instance uuid 6409e8d1-b827-4649-83ea-b853a1f203ff {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:45:15.018143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-415eae6e-8aa4-4dfb-a844-8a262173c85c) Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Request method failure captured: Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b HTTP/1.1 Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lQi9t6AtNfKIFGfoDYSuBwFOa6W--Z_4JoqOv1MJFjTxDMRnr9NzZTFKSfWiRIvwnVH2g9HzAHchjrorEdM0oMigNwrM-VcZXrdAXDzrEJp63lO7k5HU2DRLXHNkr46XviNUP6arBCw2D5IOVuGd-1zG_oBk2MH0YtbGm5hUCnq5VM Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:45:15.020464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 1c6c4f7d2e6e42b38368cf3eaffc6187 Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:45:15.022193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-415eae6e-8aa4-4dfb-a844-8a262173c85c) Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '6409e8d1-b827-4649-83ea-b853a1f203ff', 'id': 'f74ddc2e-c47f-4ff3-9bae-fc7e15da010b'} Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 09 12:45:15.023219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-415eae6e-8aa4-4dfb-a844-8a262173c85c) Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:45:15.025060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-415eae6e-8aa4-4dfb-a844-8a262173c85c) Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:45:15.026760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-415eae6e-8aa4-4dfb-a844-8a262173c85c) Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:45:15.028235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-415eae6e-8aa4-4dfb-a844-8a262173c85c) Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-415eae6e-8aa4-4dfb-a844-8a262173c85c) Aug 09 12:45:15.030869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:45:15.033192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-415eae6e-8aa4-4dfb-a844-8a262173c85c) {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:45:15.033192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-87c5234d-b725-452d-94fc-80f605c2e5c8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b" status: 400 len: 269 microversion: 2.1 time: 66.891901 Aug 09 12:45:15.033192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 945/1897] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:44:08 2022] DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b => generated 269 bytes in 66893 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:45:18.217094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:45:24.992919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:45:25.541767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:45:25.542716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:45:32.258030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:45:32.258962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:45:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b (ip 10.222.0.60) !!! Aug 09 12:45:47.923649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:45:47.924148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:45:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:46:08.251661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=4 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:46:08.257644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:46:08.258190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:46:08.265377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:46:08.265947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:46:08.266423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:46:08.267186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:46:08.267690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:46:08.268154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:46:18.262447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=2 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:46:18.287992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=4 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:47:08.745165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6471b794-65a9-4288-9c04-03f7835ea1b1) Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Request method failure captured: Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b HTTP/1.1 Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lQi9t6AtNfKIFGfoDYSuBwFOa6W--Z_4JoqOv1MJFjTxDMRnr9NzZTFKSfWiRIvwnVH2g9HzAHchjrorEdM0oMigNwrM-VcZXrdAXDzrEJp63lO7k5HU2DRLXHNkr46XviNUP6arBCw2D5IOVuGd-1zG_oBk2MH0YtbGm5hUCnq5VM Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:47:08.748235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 1c6c4f7d2e6e42b38368cf3eaffc6187 Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:47:08.749990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6471b794-65a9-4288-9c04-03f7835ea1b1) Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '6409e8d1-b827-4649-83ea-b853a1f203ff', 'id': 'f74ddc2e-c47f-4ff3-9bae-fc7e15da010b'} Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 09 12:47:08.750883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6471b794-65a9-4288-9c04-03f7835ea1b1) Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:47:08.752283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6471b794-65a9-4288-9c04-03f7835ea1b1) Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:08.754278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6471b794-65a9-4288-9c04-03f7835ea1b1) Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:47:08.755925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6471b794-65a9-4288-9c04-03f7835ea1b1) Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6471b794-65a9-4288-9c04-03f7835ea1b1) Aug 09 12:47:08.757665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:08.759549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6471b794-65a9-4288-9c04-03f7835ea1b1) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:47:08.759549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8dccec27-8960-439b-affd-357d09fc1686 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b" status: 400 len: 269 microversion: 2.1 time: 120.543013 Aug 09 12:47:08.763258 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 953/1898] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:45:08 2022] DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b => generated 269 bytes in 120557 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:47:08.770554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:47:08.771837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:47:08.778358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:47:08.778846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:47:08.779284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:47:08.780018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:47:08.780927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:47:08.781358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:47:08.902016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.objects.instance [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lazy-loading 'services' on Instance uuid 6409e8d1-b827-4649-83ea-b853a1f203ff {{(pid=117661) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:47:09.031970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.objects.instance [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lazy-loading 'services' on Instance uuid 6409e8d1-b827-4649-83ea-b853a1f203ff {{(pid=117660) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 12:47:09.070760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-075abc3c-acef-484a-b0d3-6da04f14478a) Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Request method failure captured: Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b HTTP/1.1 Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lQi9t6AtNfKIFGfoDYSuBwFOa6W--Z_4JoqOv1MJFjTxDMRnr9NzZTFKSfWiRIvwnVH2g9HzAHchjrorEdM0oMigNwrM-VcZXrdAXDzrEJp63lO7k5HU2DRLXHNkr46XviNUP6arBCw2D5IOVuGd-1zG_oBk2MH0YtbGm5hUCnq5VM Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 12:47:09.073511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 1c6c4f7d2e6e42b38368cf3eaffc6187 Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:47:09.074996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-075abc3c-acef-484a-b0d3-6da04f14478a) Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'server_id': '6409e8d1-b827-4649-83ea-b853a1f203ff', 'id': 'f74ddc2e-c47f-4ff3-9bae-fc7e15da010b'} Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 09 12:47:09.076039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-075abc3c-acef-484a-b0d3-6da04f14478a) Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:47:09.077454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-075abc3c-acef-484a-b0d3-6da04f14478a) Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.079089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-075abc3c-acef-484a-b0d3-6da04f14478a) Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:47:09.080279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-075abc3c-acef-484a-b0d3-6da04f14478a) Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-075abc3c-acef-484a-b0d3-6da04f14478a) Aug 09 12:47:09.081990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.083977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-075abc3c-acef-484a-b0d3-6da04f14478a) {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:47:09.083977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ab1a05c4-1416-4fa7-a93d-71ce34348366 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b" status: 400 len: 269 microversion: 2.1 time: 60.825153 Aug 09 12:47:09.083977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 946/1899] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:46:08 2022] DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b => generated 269 bytes in 60827 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:47:09.199131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb5ddf6-2746-4398-b505-66f1762c4b74) Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Request method failure captured: Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b HTTP/1.1 Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lQi9t6AtNfKIFGfoDYSuBwFOa6W--Z_4JoqOv1MJFjTxDMRnr9NzZTFKSfWiRIvwnVH2g9HzAHchjrorEdM0oMigNwrM-VcZXrdAXDzrEJp63lO7k5HU2DRLXHNkr46XviNUP6arBCw2D5IOVuGd-1zG_oBk2MH0YtbGm5hUCnq5VM Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 12:47:09.201411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/e57ead005fcd46e4a751225d11d4f9e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: e57ead005fcd46e4a751225d11d4f9e1 Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1259384910 Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 1c6c4f7d2e6e42b38368cf3eaffc6187 Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-VolumesSnapshotTestJSON-1259384910-project Aug 09 12:47:09.203251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb5ddf6-2746-4398-b505-66f1762c4b74) Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'server_id': '6409e8d1-b827-4649-83ea-b853a1f203ff', 'id': 'f74ddc2e-c47f-4ff3-9bae-fc7e15da010b'} Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 09 12:47:09.205064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb5ddf6-2746-4398-b505-66f1762c4b74) Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 12:47:09.207056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb5ddf6-2746-4398-b505-66f1762c4b74) Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.208661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb5ddf6-2746-4398-b505-66f1762c4b74) Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:47:09.209931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb5ddf6-2746-4398-b505-66f1762c4b74) Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb5ddf6-2746-4398-b505-66f1762c4b74) Aug 09 12:47:09.212268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 12:47:09.214023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-edb5ddf6-2746-4398-b505-66f1762c4b74) {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 12:47:09.214023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a80e11d4-d304-4d06-94bf-64dc47ac9704 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b" status: 400 len: 269 microversion: 2.1 time: 0.438565 Aug 09 12:47:09.214023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 954/1900] 10.222.0.60 () {58 vars in 1416 bytes} [Tue Aug 9 12:47:08 2022] DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff/os-volume_attachments/f74ddc2e-c47f-4ff3-9bae-fc7e15da010b => generated 269 bytes in 440 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 12:47:10.159637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:47:10.160358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:47:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:47:11.965196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:47:11.966026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:47:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:47:35.346964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:47:35.348842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:47:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:48:45.557128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:48:45.558099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:48:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:48:52.270089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:48:52.270891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:48:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:49:07.933900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:49:07.934418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:49:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:50:30.171195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:50:30.172153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:50:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:50:31.976572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:50:31.976572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:50:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:50:55.361622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:50:55.362745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:50:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:52:05.570515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:52:05.571524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:52:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:52:12.283609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:52:12.284104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:52:27.945026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:52:27.945867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:52:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:53:09.962181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bf71a9fe-b2b0-4e3d-800c-40cbc9b646de] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 12:53:09.962877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=4 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:09.968215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:09.969167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:09.976774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:09.977333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:09.977844 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:09.978567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:09.979012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:09.979427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:10.005223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Going to try to terminate instance {{(pid=117661) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:53:10.104549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-695ae0c5-6f09-488f-9466-ebc1f0093ebe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 204 len: 0 microversion: 2.1 time: 0.143590 Aug 09 12:53:10.105355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 947/1901] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:53:09 2022] DELETE /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:53:10.113159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2b02740-8145-47b1-bd08-5ced78371e44] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 12:53:10.113804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=2 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:10.114339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=8 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:10.118430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:10.119032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:10.125892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:10.126389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:10.126809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:10.127834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:10.128272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:10.128722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:10.333124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:10.341799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0fe67116-3dcc-4138-ba3f-590beaf4a897 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.230459 Aug 09 12:53:10.342399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 955/1902] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:10 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:53:11.371252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:11.372835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:11.381021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:11.381529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:11.381977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:11.382700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:11.383166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:11.383603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:11.390414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] [bf71a9fe-b2b0-4e3d-800c-40cbc9b646de] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44038. Aug 09 12:53:11.582915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:11.591858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5fe4dc6c-e513-48ad-926d-830afb33d4e7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.227356 Aug 09 12:53:11.592494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 948/1903] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:11 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:12.623600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:12.624634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:12.637650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:12.638666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:12.639101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:12.639792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:12.640241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:12.640680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:12.645930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2b02740-8145-47b1-bd08-5ced78371e44] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 44048. Aug 09 12:53:12.783003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:12.795995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2bd20772-c211-4d9d-980a-a18374f11ce3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.179822 Aug 09 12:53:12.796936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 956/1904] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:12 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:13.819261 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:13.820036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:13.828100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:13.828616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:13.829051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:13.829740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:13.830191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:13.830615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:13.964075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:13.973189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d8fa0a16-1b77-4487-9953-6b51f31c850e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.158852 Aug 09 12:53:13.973769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 949/1905] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:13 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:14.998279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:14.998987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:15.008357 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:15.008956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:15.009467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:15.010281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:15.010814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:15.011316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:15.153083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:15.163661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2add9e0-e5e9-4706-a48c-f58e17be0fbf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171931 Aug 09 12:53:15.164232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 957/1906] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:14 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:16.185966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:16.186582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:16.194312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:16.194839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:16.195488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:16.196678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:16.197513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:16.198282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:16.356570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:16.368687 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-89f01dba-7e2f-4089-b04e-e5d87063cde0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.187088 Aug 09 12:53:16.369431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 950/1907] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:16 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:17.390817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:17.391560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:17.398732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:17.399239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:17.399697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:17.400457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:17.400937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:17.401385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:17.535831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:17.544556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d784256b-57fb-497d-9edb-4b881a0c2430 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.157979 Aug 09 12:53:17.545132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 958/1908] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:17 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:18.570211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:18.571091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:18.580201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:18.580743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:18.581184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:18.581872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:18.582323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:18.582714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:18.723332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:18.731959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4108c65d-f738-48d4-819e-7f1693025687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.168447 Aug 09 12:53:18.732571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 951/1909] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:18 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:19.758187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:19.759197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:19.768287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:19.768868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:19.769299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:19.769986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:19.770433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:19.770862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:19.915094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:19.923572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-17f01844-4982-4bd5-9591-e527ce86b65b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172762 Aug 09 12:53:19.924174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 959/1910] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:19 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:20.948945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:20.949957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:20.961932 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:20.962723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:20.963439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:20.964644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:20.965395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:20.966283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:21.101080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:21.114090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7bcf0c3c-d13b-4614-9a41-ec20b65fc6ce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171469 Aug 09 12:53:21.114835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 952/1911] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:20 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:22.138732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:22.139688 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:22.146876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:22.147295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:22.147725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:22.148412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:22.148901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:22.149315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:22.289373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:22.298859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-296d580f-3356-45cb-ad3f-7f0fd4162f84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.164009 Aug 09 12:53:22.299454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 960/1912] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:22 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:23.324584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:23.325576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:23.336294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:23.337141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:23.337914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:23.339062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:23.339804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:23.340551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:23.498600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:23.511255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3de1378d-8e56-4426-b217-7dd466b0ca11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.193125 Aug 09 12:53:23.512013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 953/1913] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:23 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:24.537957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:24.538890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:24.548343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:24.548847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:24.549275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:24.549966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:24.550408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:24.550822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:24.686002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:24.694143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a3ce2f7-2321-4fbe-95c1-736259b935f4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.162858 Aug 09 12:53:24.694741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 961/1914] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:24 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:25.723379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:25.723992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:25.730823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:25.731307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:25.731742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:25.732474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:25.732925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:25.733345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:25.864706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:25.872793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-75cc565f-4250-41b2-ad98-be76a1fa6ebd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.153391 Aug 09 12:53:25.873369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 954/1915] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:25 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:26.897488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:26.898451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:26.907984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:26.908496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:26.908925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:26.909616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:26.910064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:26.910457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:27.041125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:27.049889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d731e851-d162-4963-ad65-65b6c8ff57b2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.158551 Aug 09 12:53:27.050456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 962/1916] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:26 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:28.075450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:28.076438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:28.083689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:28.084174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:28.084657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:28.085356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:28.085811 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:28.086238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:28.235146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:28.243276 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f051790e-a140-4049-9279-b582ab35722c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.174454 Aug 09 12:53:28.243854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 955/1917] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:28 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:29.269212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:29.270195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:29.281211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:29.281608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:29.282027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:29.282722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:29.283179 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:29.283603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:29.421482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:29.434140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f743969c-6268-4dcd-8530-cc19b37c2149 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171502 Aug 09 12:53:29.434906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 963/1918] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:29 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:30.460145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:30.461208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:30.472048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:30.473508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:30.474242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:30.475396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:30.476156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:30.476949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:30.632159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:30.642476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a87d095f-0064-41a9-b061-1027e3a53513 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.189514 Aug 09 12:53:30.643047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 956/1919] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:30 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:31.667896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:31.668902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:31.680554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:31.681367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:31.682087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:31.683237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:31.683997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:31.684759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:31.817566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:31.825961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4ac199fb-23d7-429e-9c3b-ab9b518a9b69 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.164610 Aug 09 12:53:31.826540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 964/1920] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:31 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:32.851199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:32.852124 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:32.863498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:32.864335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:32.865104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:32.866232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:32.866975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:32.867666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:33.013139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:33.021790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2b56253b-fdd4-4c42-8a41-b5dd90f7b857 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.177157 Aug 09 12:53:33.022358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 957/1921] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:32 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:34.047460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:34.048167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:34.056202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:34.056810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:34.057320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:34.058127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:34.058689 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:34.059190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:34.198303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:34.206710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c6c9d99f-cd2a-4654-94c7-0c8e19e55c38 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166355 Aug 09 12:53:34.207315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 965/1922] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:34 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:35.232825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:35.234048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:35.244768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:35.245581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:35.246308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:35.247462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:35.248220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:35.248993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:35.382207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:35.395047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1522f32c-83c5-41fc-82a9-f703af86e34c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.168683 Aug 09 12:53:35.395855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 958/1923] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:35 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:36.423533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:36.424317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:36.432744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:36.433350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:36.433886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:36.434742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:36.435306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:36.435834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:36.571293 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:36.580324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad0e353c-1407-48c5-a1d1-f382be8cf336 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.162744 Aug 09 12:53:36.580837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 966/1924] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:36 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:37.602445 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:37.603058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:37.609688 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:37.610206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:37.610642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:37.611337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:37.611794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:37.612219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:37.762552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:37.770979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-800ce387-7e2f-4931-a5a1-5c0904035d01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172475 Aug 09 12:53:37.771569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 959/1925] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:37 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:38.795437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:38.796515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:38.804257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:38.804775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:38.805205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:38.805889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:38.806334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:38.806780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:38.951404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:38.963893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67150005-c0fb-4bf3-bbfc-d67660d8eb7e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.174744 Aug 09 12:53:38.964730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 967/1926] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:38 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:39.988602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:39.989248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:39.991497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:39.996782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:39.997253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:39.997689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:39.998363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:39.998804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:39.999221 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:40.002543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:40.142901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:40.151159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-267c75b6-f343-464c-9fe6-65f4d4707a14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167437 Aug 09 12:53:40.151764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 960/1927] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:39 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:41.176265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:41.177407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:41.181190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=27 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:41.189902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:41.190380 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:41.190806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:41.191505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:41.191952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:41.192370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:41.195054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=79 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:41.327216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:41.335733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2eb767c2-58b4-4847-9feb-c9b37b204d11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166472 Aug 09 12:53:41.336296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 968/1928] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:41 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:42.360928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:42.361584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:42.368142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:42.368665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:42.369096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:42.369787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:42.370234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:42.370653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:42.510705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:42.519116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-675bcef0-dbe4-4731-8acb-01de9dc03c29 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.164215 Aug 09 12:53:42.519692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 961/1929] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:42 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:43.541229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:43.541833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:43.548740 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:43.549217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:43.549645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:43.550332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:43.550779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:43.551191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:43.688298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:43.697062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1d545f0e-76de-42d8-9d09-116768f887f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.159906 Aug 09 12:53:43.697653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 969/1930] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:43 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:44.722418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:44.723388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:44.734238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:44.735044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:44.735443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:44.736130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:44.736618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:44.737035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:44.887707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:44.898400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5c27f71c-dc44-4873-938a-3800cd6e4a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.182467 Aug 09 12:53:44.899228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 962/1931] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:44 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:45.920776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:45.921384 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:45.929154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:45.929633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:45.930066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:45.930761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:45.931216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:45.931637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:46.080203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:46.088888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f5255e87-3154-42e4-ab6a-d2a1e6a21074 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172096 Aug 09 12:53:46.089454 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 970/1932] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:45 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:47.114780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:47.115777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:47.126603 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:47.127449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:47.127923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:47.128644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:47.129103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:47.129522 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:47.277510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:47.286654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c554a851-05e2-49e6-9040-187710822696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.178468 Aug 09 12:53:47.287226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 963/1933] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:47 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:48.312154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:48.313135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:48.324323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:48.325161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:48.325866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:48.326988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:48.327738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:48.328441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:48.465303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:48.475358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f1e9da1-6bf0-4a36-8eeb-32c9379cd192 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.169425 Aug 09 12:53:48.476162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 971/1934] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:48 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:49.500857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:49.501827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:49.510299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:49.510791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:49.511230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:49.511929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:49.512400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:49.512833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:49.649398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:49.661243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fd14f792-24f8-4bb4-b951-89635beaf581 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166955 Aug 09 12:53:49.662019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 964/1935] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:49 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:50.183926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:53:50.184878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:53:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:53:50.691339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:50.692339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:50.703040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:50.703834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:50.704607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:50.705815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:50.706373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:50.706783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:50.852705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:50.865259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-21b30c62-6251-4613-a0d3-8e4e18481760 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.180316 Aug 09 12:53:50.866093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 972/1936] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:50 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:51.892137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:51.892858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:51.899896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:51.900338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:51.900799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:51.901505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:51.901953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:51.902371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:51.999214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:53:51.999388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:53:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff (ip 10.222.0.60) !!! Aug 09 12:53:52.046754 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:52.055069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-09ad57fe-69f2-4701-8153-57ba52eb86e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170130 Aug 09 12:53:52.055637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 965/1937] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:51 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:53.075440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:53.076056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:53.083269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:53.083761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:53.084198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:53.084928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:53.085381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:53.085808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:53.220792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:53.229221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-59038f3a-157c-4894-8b31-60290a5c523d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.157750 Aug 09 12:53:53.229792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 973/1938] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:53 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:54.254951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:54.256028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:54.267111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:54.268085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:54.269098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:54.269855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:54.270330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:54.270732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:54.417761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:54.428262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c0d5177-f6f5-4f34-8252-10d4c302d4e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.180860 Aug 09 12:53:54.428880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 966/1939] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:54 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:55.461079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:55.462036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:55.472933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:55.473411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:55.473842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:55.474528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:55.474971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:55.475391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:55.617574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:55.631488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5fcc1ed-7e6e-4e1d-a3ef-1145268e3e9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.176902 Aug 09 12:53:55.632432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 974/1940] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:55 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:56.661557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:56.662310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:56.673174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:56.673914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:56.674585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:56.675443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:56.676049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:56.705885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:56.812701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:56.820826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4a61c80a-8a90-488b-8c3f-6b4e8e3b3cf0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.165753 Aug 09 12:53:56.821393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 967/1941] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:56 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:57.845502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:57.846161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:57.856029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:57.856770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:57.857420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:57.858482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:57.859137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:57.859726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:58.001841 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:58.015318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e7ed11b-2d92-4bf8-831b-39748da2e044 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.175784 Aug 09 12:53:58.016194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 975/1942] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:57 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:53:59.042389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:53:59.043380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:53:59.054410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:59.055109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:59.055838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:59.057078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:53:59.057826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:53:59.058525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:53:59.191934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:53:59.200652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6c5b23ce-960c-4f32-97d7-94a30bce1141 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.164912 Aug 09 12:53:59.201233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 968/1943] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:53:59 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:00.224870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:00.225519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:00.234424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:00.235067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:00.235638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:00.236599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:00.237233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:00.237789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:00.377341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:00.385565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bfbd7ab6-c44f-4d07-a899-1253d3867f1f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166300 Aug 09 12:54:00.386132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 976/1944] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:00 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:01.409600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:01.410578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:01.417590 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:01.418012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:01.418451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:01.419146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:01.419596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:01.420019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:01.562952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:01.571566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-16e7ce99-7c9b-428d-bd50-c14e8cb14485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167351 Aug 09 12:54:01.572170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 969/1945] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:01 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:02.596555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:02.597436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:02.608933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:02.609764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:02.610481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:02.611600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:02.612349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:02.613244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:02.756927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:02.765397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ee0f7727-368f-41d9-9308-09902b62389e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.175513 Aug 09 12:54:02.765993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 977/1946] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:02 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:03.798535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:03.799567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:03.810343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:03.811123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:03.811880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:03.813078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:03.813836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:03.814539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:03.962451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:03.973462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ec8946f3-5f1b-45d8-821a-666ea8b531a2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.180946 Aug 09 12:54:03.974241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 970/1947] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:03 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:04.999401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:05.000436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:05.009098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:05.009577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:05.010008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:05.010694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:05.011533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:05.011533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:05.142722 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:05.151072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8364de12-3b65-46f6-96e3-94c0080de985 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.158069 Aug 09 12:54:05.151639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 978/1948] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:04 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:06.174878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:06.175567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:06.182722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:06.183200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:06.183633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:06.184325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:06.184815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:06.185239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:06.329100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:06.337552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dce39657-6307-4bf2-9eb6-0ad8c0f99cfe tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.168132 Aug 09 12:54:06.338108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 971/1949] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:06 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:07.363231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:07.364205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:07.374817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:07.375604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:07.376421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:07.377926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:07.378676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:07.379379 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:07.518491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:07.527068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0decf11b-1b08-4397-9c58-40e2cff95cc5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170426 Aug 09 12:54:07.527648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 979/1950] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:07 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:08.548218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:08.548850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:08.556056 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:08.556575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:08.557017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:08.557706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:08.558155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:08.558573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:08.703926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:08.716052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-35133897-8bc5-4d00-a4e9-792575390306 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171507 Aug 09 12:54:08.716880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 972/1951] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:08 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:10.020911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:10.021549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:10.027653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:10.028139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:10.028615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:10.029306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:10.029758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:10.030153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:10.180556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:10.188785 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fee8df06-2df3-4866-bcf5-198d7def5ede tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.453143 Aug 09 12:54:10.189616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 980/1952] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:09 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:11.211348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:11.211961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:11.214313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=26 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:11.219618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:11.220105 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:11.220594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:11.221292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:11.221742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:11.222234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:11.226158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=78 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:11.365102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:11.378443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-833f2b89-ab1e-4630-88a9-dcf3501cc3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171160 Aug 09 12:54:11.379054 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 973/1953] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:11 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:12.408345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:12.409187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:12.412296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=26 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:12.419576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:12.420220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:12.420831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:12.421758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:12.422359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:12.422927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:12.426629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=78 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:12.555800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:12.563886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d9c70161-dd64-4c6e-886d-5763e10a1813 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.160917 Aug 09 12:54:12.564480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 981/1954] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:12 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:13.585582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:13.586103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:13.592682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:13.593151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:13.593589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:13.594264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:13.594709 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:13.595141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:13.724677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:13.732802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e5c8d8c5-780c-4a6c-b961-86dc7189ee3a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.151479 Aug 09 12:54:13.733342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 974/1955] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:13 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:14.757640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:14.758387 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:14.766161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:14.766732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:14.767245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:14.768059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:14.768641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:14.769151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:14.910031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:14.918329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-166a2921-f3d0-454c-904b-eb032a320212 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166734 Aug 09 12:54:14.918926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 982/1956] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:14 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:15.374431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:54:15.374581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:54:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:54:15.940424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:15.940935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:15.948367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:15.948914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:15.949334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:15.950032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:15.950477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:15.950897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:16.099383 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:16.115202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d7c94c80-bf3f-49aa-b105-9f16da39e2e3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.178843 Aug 09 12:54:16.115785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 975/1957] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:15 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:17.137863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:17.138411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:17.145647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:17.146176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:17.146603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:17.147287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:17.147735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:17.148146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:17.291578 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:17.300296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22021d28-abcb-4647-99e9-b8af687a32bd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166444 Aug 09 12:54:17.300897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 983/1958] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:17 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:18.326838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:18.327837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:18.336482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:18.336964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:18.337401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:18.338094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:18.338545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:18.339012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:18.474094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:18.482294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b12b9354-49d8-4f30-bf9c-2c3d9ab012a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.162054 Aug 09 12:54:18.482873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 976/1959] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:18 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:19.506847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:19.507473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:19.514090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:19.514567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:19.514992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:19.515684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:19.516124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:19.516598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:19.657517 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:19.666254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-79036b75-01d8-4001-bab6-3a24f64d5e0c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.165026 Aug 09 12:54:19.666823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 984/1960] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:19 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:20.691526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:20.692428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:20.699270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:20.699753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:20.700185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:20.700914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:20.701363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:20.701786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:20.833748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:20.842103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a53cfa62-eaba-4bde-a89b-4e159e1b3a2d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.157256 Aug 09 12:54:20.842676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 977/1961] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:20 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:21.866667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:21.867209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:21.874512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:21.875014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:21.875495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:21.876221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:21.876732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:21.877526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:22.011133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:22.019301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7df90e1d-7558-47c3-8c16-6666bdc41090 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.158389 Aug 09 12:54:22.019882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 985/1962] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:21 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:23.044981 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:23.046021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:23.056902 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:23.057713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:23.058420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:23.059562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:23.060318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:23.061064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:23.199520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:23.207816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7ec6efe1-b7d6-4db8-bd27-9220984ca33f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.169393 Aug 09 12:54:23.208443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 978/1963] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:23 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:24.233320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:24.234122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:24.243215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:24.243692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:24.244118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:24.244836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:24.245279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:24.245694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:24.378261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:24.390132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d1165d9-6874-4371-91b5-e6e16c8b4250 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.163227 Aug 09 12:54:24.390918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 986/1964] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:24 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:25.416574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:25.417569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:25.428809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:25.429599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:25.430311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:25.431440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:25.432183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:25.432923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:25.573645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:25.582351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2efe2264-ab70-4446-be04-298d92ab1ef1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172502 Aug 09 12:54:25.583031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 979/1965] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:25 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:26.614508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:26.615115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:26.621853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:26.622557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:26.622994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:26.623725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:26.624189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:26.624667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:27.038506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:27.048056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97e1c565-5015-41fe-a7be-bf9d2f4ccc55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.439652 Aug 09 12:54:27.048697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 987/1966] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:26 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:28.074408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:28.075401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:28.085272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:28.085749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:28.086177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:28.086864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:28.087308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:28.087723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:28.238138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:28.247121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-138221c5-9eb5-41f2-8f85-7e4004105f3b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.179832 Aug 09 12:54:28.247677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 980/1967] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:28 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:29.273887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:29.274882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:29.285957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:29.286427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:29.286859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:29.287550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:29.287998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:29.288411 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:29.430048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:29.438415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa1c1183-001d-4c0a-8aa2-d619ddcd159c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171430 Aug 09 12:54:29.438948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 988/1968] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:29 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:30.463683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:30.464700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:30.474863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:30.475348 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:30.475780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:30.476519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:30.476972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:30.477391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:30.610543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:30.618800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-da5ac357-7772-401d-bfa4-5d5021073fd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.162029 Aug 09 12:54:30.619274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 981/1969] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:30 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:31.646922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:31.647575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:31.654591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:31.655076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:31.655500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:31.656182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:31.656655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:31.657071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:31.789135 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:31.797319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fd15787a-31f0-40ba-a263-7e27ceda0120 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.155965 Aug 09 12:54:31.797887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 989/1970] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:31 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:32.822954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:32.823968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:32.835515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:32.836323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:32.837095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:32.838278 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:32.839008 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:32.839715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:32.992110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:33.000224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-62f66d8b-63e7-4867-a6ee-362e37aec05c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.184024 Aug 09 12:54:33.000844 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 982/1971] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:32 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:34.021426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:34.022030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:34.029076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:34.029554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:34.029987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:34.030680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:34.031129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:34.031544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:34.177262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:34.190308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3a0bb732-355b-4f7e-b5c9-fc37feae91d4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172544 Aug 09 12:54:34.191068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 990/1972] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:34 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:35.215912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:35.216566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:35.227195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:35.227887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:35.228533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:35.229487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:35.230155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:35.230795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:35.373469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:35.382297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d8f2e7ce-cc0a-45d1-949c-e17fdcd8b9d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.173033 Aug 09 12:54:35.382895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 983/1973] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:35 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:36.407298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:36.408086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:36.416144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:36.416660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:36.417098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:36.417796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:36.418242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:36.418664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:36.550858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:36.559241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a505ec77-6e79-47fa-8bc9-78521ce0510c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.158318 Aug 09 12:54:36.559858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 991/1974] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:36 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:37.584670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:37.585666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:37.596593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:37.597394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:37.598114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:37.599237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:37.599691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:37.600111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:37.741969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:37.750560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-13b6dd11-9ab3-4ded-a786-fcb385439d77 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172547 Aug 09 12:54:37.751108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 984/1975] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:37 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:38.777415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:38.778435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:38.789447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:38.790243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:38.790954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:38.792076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:38.792878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:38.793617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:38.927390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:38.936486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-613eb139-c973-4c3d-a015-b69343768b55 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166130 Aug 09 12:54:38.937063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 992/1976] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:38 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:39.961388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:39.962033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:39.969009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:39.969542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:39.969943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:39.970639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:39.971094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:39.971520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:40.111078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:40.119479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b128b1a1-ba4a-45f7-978c-2bee92e833e5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.163526 Aug 09 12:54:40.120053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 985/1977] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:39 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:41.145700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:41.146518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:41.156874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:41.157613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:41.158274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:41.159307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:41.160153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:41.160823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:41.306894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:41.317447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-45a3ce4b-c485-4c72-b423-3fc1a058b91d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.178664 Aug 09 12:54:41.318040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 993/1978] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:41 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:42.349970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:42.351487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:42.354211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=26 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:42.363039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:42.363825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:42.364585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:42.365757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:42.366362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:42.366792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:42.369439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=78 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:42.504067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:42.513677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bea64431-30d3-40ff-bbbc-3f0c7e0bc835 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170336 Aug 09 12:54:42.514268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 986/1979] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:42 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:43.540342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:43.541199 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:43.544888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=26 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:43.554087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:43.554618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:43.555055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:43.555757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:43.556207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:43.556655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:43.559444 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=78 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:43.691836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:43.700635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e09ce81d-1523-4d5d-be28-b3600c9dff11 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167674 Aug 09 12:54:43.701180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 994/1980] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:43 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:44.726848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:44.727507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:44.736009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:44.736663 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:44.737208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:44.738066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:44.738635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:44.739143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:44.881032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:44.891339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3939088e-af71-42e0-8c54-34c750e6d6f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170772 Aug 09 12:54:44.891903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 987/1981] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:44 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:45.912887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:45.913567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:45.920432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:45.920948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:45.921365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:45.922087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:45.922540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:45.922976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:46.081639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:46.090999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-519ebf7b-eda6-41de-934f-dec419084485 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.182121 Aug 09 12:54:46.091575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 995/1982] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:45 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:47.114533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:47.115117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:47.125478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:47.126082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:47.127021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:47.128525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:47.129297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:47.129876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:47.270330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:47.278790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-48980a2d-2c37-4f0d-a753-48efa6d28297 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170146 Aug 09 12:54:47.279366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 988/1983] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:47 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:48.303899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:48.305022 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:48.312901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:48.313433 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:48.313908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:48.314676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:48.315176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:48.315640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:48.454735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:48.463481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-eee9c394-e863-43a4-a7a4-b4d733cf076d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166011 Aug 09 12:54:48.464052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 996/1984] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:48 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:49.488601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:49.489651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:49.498354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:49.499111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:49.499803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:49.500951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:49.502011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:49.502695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:49.642230 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:49.650750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ee27426c-b29b-433d-afdb-34d79136b232 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.168928 Aug 09 12:54:49.651294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 989/1985] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:49 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:50.676180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:50.677085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:50.687976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:50.688831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:50.689549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:50.690773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:50.691503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:50.692211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:50.837499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:50.845543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a22c0bf9-91ba-4bf7-9c3f-95f5504dee2b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.176008 Aug 09 12:54:50.846109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 997/1986] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:50 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:51.870219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:51.870813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:51.879049 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:51.879607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:51.880110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:51.880952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:51.881489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:51.881979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:52.018741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:52.027324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fa583e63-fc58-44ed-aa93-ac205cf70dce tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.163527 Aug 09 12:54:52.027908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 990/1987] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:51 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:53.052927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:53.053914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:53.064758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:53.065580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:53.066273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:53.067469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:53.068223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:53.068966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:53.205772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:53.216743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3d9c251f-8293-4a18-9266-8af2ca32c472 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170538 Aug 09 12:54:53.217322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 998/1988] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:53 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:54.242175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:54.243218 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:54.250415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:54.250894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:54.251319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:54.252342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:54.252808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:54.253238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:54.389973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:54.402089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a1937179-4c6c-4fb9-87bd-f1b172e6b113 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166261 Aug 09 12:54:54.402931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 991/1989] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:54 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:55.427735 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:55.428786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:55.439585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:55.440421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:55.441156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:55.442289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:55.443088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:55.443753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:55.580412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:55.588544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-47e14ffa-a395-4935-af2e-a759a439acb3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167319 Aug 09 12:54:55.589117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 999/1990] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:55 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:56.614566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:56.615553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:56.626951 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:56.627793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:56.628578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:56.629723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:56.630475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:56.631311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:56.769652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:56.778889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2aac2eb6-a3e5-4dba-8e55-ee82321bc0a3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170941 Aug 09 12:54:56.779465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 992/1991] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:56 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:57.806051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:57.807810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:57.817683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:57.819676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:57.820127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:57.820870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:57.821323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:57.821733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:57.968803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:57.981370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2d1b7a59-414f-46ba-b011-efed54d726cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.183363 Aug 09 12:54:57.982112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1000/1992] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:57 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:54:59.007952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:54:59.008992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:54:59.019939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:59.020812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:59.021542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:59.022707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:54:59.023449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:54:59.024168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:54:59.169527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:54:59.178239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-df7d493c-d37c-409a-b680-c1200b3efb9e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.177469 Aug 09 12:54:59.178792 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 993/1993] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:54:58 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:00.202499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:00.203045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:00.209698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:00.210264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:00.210616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:00.211315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:00.211760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:00.212173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:00.357929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:00.371259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c2951bb-5ded-436d-8e81-a7537525c46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.173596 Aug 09 12:55:00.371838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1001/1994] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:00 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:01.396694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:01.397799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:01.405825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:01.406290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:01.406737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:01.407437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:01.407896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:01.408318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:01.538094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:01.547517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-be00bf40-ed1d-4c44-903b-a0098a807fe5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.157413 Aug 09 12:55:01.548095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 994/1995] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:01 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:02.573870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:02.574786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:02.585766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:02.586554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:02.587269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:02.588428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:02.589286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:02.589730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:02.733903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:02.742537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4ad6e0d-3f49-4c3b-848a-25d6e253471b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.175388 Aug 09 12:55:02.743080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1002/1996] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:02 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:03.768517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:03.769567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:03.779775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:03.780632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:03.781356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:03.782500 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:03.783256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:03.783980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:03.919827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:03.928125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cd6ed5a9-6275-419b-9ca1-4462c442face tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167138 Aug 09 12:55:03.928757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 995/1997] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:03 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:04.949467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:04.950072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:04.956967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:04.957447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:04.957880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:04.958589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:04.959226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:04.959642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:05.105358 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:05.113884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-24f2c3b6-0bae-4c04-8e4a-e0a258a457a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.168335 Aug 09 12:55:05.114692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1003/1998] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:04 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:06.136481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:06.137096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:06.143927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:06.144334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:06.144797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:06.145485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:06.145933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:06.146475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:06.278576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:06.286664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-515d4f4c-cf02-4d4c-bb92-5dda12fb8bb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.154478 Aug 09 12:55:06.287208 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 996/1999] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:06 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:07.316727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:07.317715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:07.329338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:07.330139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:07.330906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:07.332047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:07.332840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:07.333543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:07.468204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:07.476592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-da4f5290-0b96-4bda-8323-58cdc82224a0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166449 Aug 09 12:55:07.477163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1004/2000] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:07 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:08.498361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:08.498983 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:08.506246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:08.506720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:08.507135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:08.507883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:08.508322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:08.508822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:08.647444 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:08.655825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-88310703-6e60-4e2d-9186-b7b9370b1bde tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.161551 Aug 09 12:55:08.656302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 997/2001] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:08 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:09.033880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:09.034591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:09.041891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:09.042647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:09.043078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:09.043766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:09.044208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:09.044791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:09.073390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Going to try to terminate instance {{(pid=117660) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 12:55:09.094526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-269889d4-0041-4857-8183-8ca476a1ce7a req-a801f254-f62a-4f59-b090-73c133593af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeda6f80-e084-4b10-ae40-27df258a9d91", "tag": "ce375374-7026-4900-8816-8278e724722e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:55:09.104234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-269889d4-0041-4857-8183-8ca476a1ce7a req-a801f254-f62a-4f59-b090-73c133593af4 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:09.105092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-269889d4-0041-4857-8183-8ca476a1ce7a req-a801f254-f62a-4f59-b090-73c133593af4 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:09.105514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-269889d4-0041-4857-8183-8ca476a1ce7a req-a801f254-f62a-4f59-b090-73c133593af4 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:09.123796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-269889d4-0041-4857-8183-8ca476a1ce7a req-a801f254-f62a-4f59-b090-73c133593af4 service nova] Creating event network-changed:ce375374-7026-4900-8816-8278e724722e for instance eeda6f80-e084-4b10-ae40-27df258a9d91 on hv-cinder-85236 Aug 09 12:55:09.129680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-269889d4-0041-4857-8183-8ca476a1ce7a req-a801f254-f62a-4f59-b090-73c133593af4 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097877 Aug 09 12:55:09.130291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 998/2002] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:55:09.158514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56847b09-6edb-4b52-a223-eca42cc8f4c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "DELETE /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 204 len: 0 microversion: 2.1 time: 0.128545 Aug 09 12:55:09.159263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1005/2003] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 12:55:09 2022] DELETE /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 12:55:09.168302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:09.169084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:09.183636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:09.184120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:09.184593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:09.185336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:09.185787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:09.186205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:09.333300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:09.341069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a4d03e1a-57da-464e-8ea4-31780d01a3ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1579 microversion: 2.1 time: 0.177310 Aug 09 12:55:09.341638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 999/2004] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:09 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1579 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:09.677096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:09.678320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:09.684676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:09.685245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:09.685686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:09.686441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:09.686916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:09.687338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:09.856711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:09.865569 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-92dea054-a823-439c-ae4c-12255f33df14 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.192661 Aug 09 12:55:09.866234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1006/2005] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:09 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:55:10.367003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:10.367809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:10.375786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:10.376279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:10.377094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:10.377817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:10.378249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:10.378689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:10.606360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:10.614405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ade545bc-75aa-459f-877f-adf9f053e53f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1460 microversion: 2.1 time: 0.254052 Aug 09 12:55:10.615069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1000/2006] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:10 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1460 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:10.888176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:10.888798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:10.895916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:10.896491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:10.896919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:10.897604 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:10.898060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:10.898473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:10.968304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [req-17056a47-3492-466d-8f00-885b96cd63e5 req-65cb4140-c03b-4dec-8b1b-c73e2c877be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeda6f80-e084-4b10-ae40-27df258a9d91", "name": "network-vif-deleted", "tag": "ce375374-7026-4900-8816-8278e724722e"}]} {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:55:10.978072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-17056a47-3492-466d-8f00-885b96cd63e5 req-65cb4140-c03b-4dec-8b1b-c73e2c877be0 service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:10.978679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-17056a47-3492-466d-8f00-885b96cd63e5 req-65cb4140-c03b-4dec-8b1b-c73e2c877be0 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:10.979103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [req-17056a47-3492-466d-8f00-885b96cd63e5 req-65cb4140-c03b-4dec-8b1b-c73e2c877be0 service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:10.991575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.compute.server_external_events [req-17056a47-3492-466d-8f00-885b96cd63e5 req-65cb4140-c03b-4dec-8b1b-c73e2c877be0 service nova] Creating event network-vif-deleted:ce375374-7026-4900-8816-8278e724722e for instance eeda6f80-e084-4b10-ae40-27df258a9d91 on hv-cinder-85236 Aug 09 12:55:10.996604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [req-17056a47-3492-466d-8f00-885b96cd63e5 req-65cb4140-c03b-4dec-8b1b-c73e2c877be0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095369 Aug 09 12:55:10.997201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1001/2007] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 12:55:11.045281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:11.053626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b586576c-7715-47e0-ae28-154a0dee023e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170113 Aug 09 12:55:11.054167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1007/2008] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:10 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:11.641623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:11.642679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:11.652532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:11.653074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:11.653508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:11.654203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:11.654653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:11.655072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:11.717053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:11.724873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-96b37f17-37d5-469d-bc21-148ab1139613 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090751 Aug 09 12:55:11.725465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1002/2009] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:11 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:12.082382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:12.083340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:12.094738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:12.095526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:12.096367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:12.097566 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:12.098321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:12.099007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:12.244705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:12.254023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8c26fca5-be4c-4673-922b-061d088498c2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.178135 Aug 09 12:55:12.254595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1008/2010] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:12 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:12.757231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:12.758262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:12.761855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=34 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:12.767553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:12.768038 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:12.768509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:12.769200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:12.769657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:12.770077 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:12.772817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=94 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:12.839888 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:12.848071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-70c9d9a6-5d35-4486-9cdf-23c305665483 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097872 Aug 09 12:55:12.848684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1003/2011] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:12 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:13.278875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:13.279392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:13.286839 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:13.287320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:13.287752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:13.288479 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:13.288925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:13.289346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:13.292027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:13.429794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:13.438547 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35cc28c8-0c85-4f78-b4db-4a4cacafce6e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.165812 Aug 09 12:55:13.439139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1009/2012] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:13 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:13.872468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:13.873083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:13.881037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:13.881575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:13.882050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:13.882798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:13.883298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:13.883757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:13.954395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:13.962971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e8556043-7e07-40c6-819b-3d4661177bb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096175 Aug 09 12:55:13.963534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1004/2013] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:13 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:14.464773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:14.465828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:14.469498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:14.478803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:14.480029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:14.480159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:14.480960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:14.481413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:14.481862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:14.622263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:14.631048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc91cf37-088a-49df-8a38-fc9c3311fcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.173693 Aug 09 12:55:14.631626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1010/2014] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:14 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:14.988839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:14.989844 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:15.001327 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:15.002519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:15.003244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:15.004436 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:15.005201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:15.005898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:15.070847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:15.079066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3db5e3cd-d6ed-4a59-bdaa-f19b65592370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096776 Aug 09 12:55:15.079634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1005/2015] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:14 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:55:15.654871 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:15.655506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:15.663146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:15.663684 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:15.664164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:15.664965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:15.665471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:15.665930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:15.816997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:15.825326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2e977f6-f4ef-40c2-906c-e3a59885214a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.175691 Aug 09 12:55:15.825893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1011/2016] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:15 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:16.102327 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:16.102960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:16.112599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:16.113090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:16.114226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:16.114226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:16.114775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:16.115297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:16.201887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:16.207633 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c1bd44c3-f7d8-42e8-8652-56669daec28f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.110251 Aug 09 12:55:16.208417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1006/2017] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:16 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:16.847004 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:16.847558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:16.854725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:16.855195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:16.855625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:16.856308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:16.856968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:16.857212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:17.003160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:17.012849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1ed4d54e-9048-42ae-9169-d189a4a27cfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170029 Aug 09 12:55:17.013559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1012/2018] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:16 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:17.232680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:17.233206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:17.240591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:17.241074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:17.241505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:17.242192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:17.242641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:17.243057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:17.308892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:17.319693 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f53279c6-f14c-4b0c-8226-aaa3fbba3ef3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091007 Aug 09 12:55:17.320500 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1007/2019] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:17 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:18.034249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:18.034835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:18.041556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:18.042039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:18.042475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:18.043165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:18.043617 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:18.044037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:18.175093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:18.183317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c029e1c5-e92e-4501-8dba-1c57af34713f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.153059 Aug 09 12:55:18.184177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1013/2020] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:18 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:18.342960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:18.343564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:18.350359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:18.350834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:18.351237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:18.352030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:18.352514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:18.352928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:18.415998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:18.427476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-238f264c-dd21-4d3d-b2b3-dda31d73cc8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088536 Aug 09 12:55:18.428205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1008/2021] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:18 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:19.208208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:19.209122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:19.218861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:19.219344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:19.219778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:19.220502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:19.220958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:19.221382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:19.365672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:19.374438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-71ae964d-75b5-4840-a56a-fd717cdafbcf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.173031 Aug 09 12:55:19.375034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1014/2022] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:19 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:19.450999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:19.451813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:19.458870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:19.459281 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:19.459709 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:19.460411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:19.460872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:19.461285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:19.525575 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:19.533691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-48168871-ce11-44a3-b252-ea138337cf36 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.086809 Aug 09 12:55:19.534293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1009/2023] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:19 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:20.401565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:20.402245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:20.413067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:20.413805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:20.414457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:20.415526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:20.416227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:20.416876 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:20.550399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:20.554548 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:20.555156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:20.558983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-03cc09a1-6d5c-445d-b0ad-d89b35c85c06 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.161956 Aug 09 12:55:20.559560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1015/2024] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:20 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:20.562311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:20.562804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:20.563237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:20.563930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:20.564397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:20.564830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:20.627723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:20.635610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9494ab99-e018-43d7-8cb0-3d14800ea951 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.084872 Aug 09 12:55:20.636184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1010/2025] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:20 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:55:21.583624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:21.584616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:21.594072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:21.594545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:21.594972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:21.595774 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:21.596216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:21.596634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:21.657283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:21.657878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:21.664755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:21.665237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:21.665678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:21.666361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:21.666808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:21.667233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:21.732983 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:21.740815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d7479e54-21d0-4d0a-ae22-b474048e286b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087522 Aug 09 12:55:21.741421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1011/2026] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:21 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:21.754144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:21.765532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c445ac60-fb19-44d0-9f5e-dcca2915d0be tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.188336 Aug 09 12:55:21.766111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1016/2027] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:21 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:22.767239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:22.768253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:22.779326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:22.779728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:22.780168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:22.780897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:22.781355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:22.781782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:22.786838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:22.787417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:22.794057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:22.794548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:22.795230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:22.795939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:22.796409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:22.796899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:22.848437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:22.856269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-301e322b-89fb-4235-9c0d-7c648016a83a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096135 Aug 09 12:55:22.856891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1012/2028] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:22 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:22.941190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:22.949855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a6a2a00-b581-4815-b5db-aa7d1f3b3b47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166850 Aug 09 12:55:22.950441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1017/2029] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:22 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:23.881729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:23.882731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:23.891829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:23.892312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:23.892768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:23.893461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:23.893909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:23.894324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:23.959354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:23.967175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ffc497a9-33ea-4083-9690-eb79442a88dd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092386 Aug 09 12:55:23.967912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1013/2030] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:23 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:23.971333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:23.971943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:23.978635 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:23.979113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:23.979541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:23.980221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:23.980696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:23.981109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:24.125328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:24.137767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-189125dd-7593-4ab4-a3f1-2a9316efb95c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.169974 Aug 09 12:55:24.138494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1018/2031] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:23 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:24.992205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:24.993235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:25.002097 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:25.002573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:25.003000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:25.003683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:25.004130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:25.004583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:25.074242 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:25.082432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8afe330f-328b-4e19-8a20-2fb36205c05b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096815 Aug 09 12:55:25.082998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1014/2032] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:24 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:25.162306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:25.163049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:25.173109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:25.173812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:25.174440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:25.175424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:25.176078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:25.176830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:25.315105 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:25.327721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-12be977d-c94e-4c0f-8c8d-7b13bbbf1a78 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171096 Aug 09 12:55:25.328595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1019/2033] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:25 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:25.583479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:55:25.583764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:55:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:55:26.103501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:26.104145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:26.111331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:26.111806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:26.112259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:26.112972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:26.113417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:26.113829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:26.180068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:26.191420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c4776e5-63f0-4dc5-af19-1d7b948d84e8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091501 Aug 09 12:55:26.192204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1015/2034] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:26 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:26.357990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:26.358686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:26.366534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:26.367110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:26.367645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:26.368446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:26.369010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:26.369515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:26.513944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:26.524278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1b5d12cf-fbf7-4539-b5fa-f07ecc741825 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.173118 Aug 09 12:55:26.525024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1020/2035] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:26 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:27.216485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:27.217370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:27.224140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:27.224656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:27.225081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:27.225765 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:27.226211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:27.226624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:27.293469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:27.301722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fbf35cd2-6638-487c-8ae4-7ac1dbb74973 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089210 Aug 09 12:55:27.302288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1016/2036] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:27 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:27.549777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:27.550377 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:27.560777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:27.561407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:27.561838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:27.562536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:27.562986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:27.563407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:27.698249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:27.706947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-84f595ff-d934-4004-97cb-b3984ddaf1d7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.163603 Aug 09 12:55:27.707521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1021/2037] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:27 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:28.326706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:28.327423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:28.334140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:28.334620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:28.335048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:28.335734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:28.336178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:28.336629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:28.399486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:28.407583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4813ea1a-52fe-4bf1-8833-b999d3903770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087445 Aug 09 12:55:28.408174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1017/2038] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:28 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:28.733788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:28.734588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:28.745446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:28.746237 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:28.746950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:28.748080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:28.748790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:28.749210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:28.889966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:28.899461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5238df6e-b0db-4bdb-a1d8-be1344cdd046 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172773 Aug 09 12:55:28.900077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1022/2039] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:28 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:29.433286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:29.434318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:29.445335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:29.446128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:29.446837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:29.447966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:29.448764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:29.449475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:29.517438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:29.528456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-98ee0dcd-0acb-4b42-9415-1e8277d70608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101905 Aug 09 12:55:29.529195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1018/2040] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:29 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:29.922683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:29.923381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:29.930647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:29.931130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:29.931634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:29.932342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:29.932832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:29.933267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:30.072945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:30.081489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-822bb64e-7131-4b26-8e7f-107ef36ec277 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.163644 Aug 09 12:55:30.082071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1023/2041] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:29 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:30.552685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:30.553415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:30.562748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:30.563225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:30.563660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:30.564372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:30.564861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:30.565277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:30.631157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:30.633354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:30.639759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-33189dd3-2260-4233-abe3-228497212770 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093330 Aug 09 12:55:30.640319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1019/2042] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:30 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:31.106829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:31.107920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:31.118714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:31.119503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:31.120211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:31.121428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:31.122167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:31.122870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:31.263452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:31.273114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e75b195-6b86-497a-a24e-5cddd0c6da47 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172801 Aug 09 12:55:31.273730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1024/2043] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:31 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:31.665737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:31.666729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:31.675295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:31.675776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:31.676211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:31.676936 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:31.677383 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:31.677801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:31.744028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:31.752547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9b1b241f-0632-41a8-ab9f-f00597dfe360 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093785 Aug 09 12:55:31.753092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1020/2044] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:31 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:32.295036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:55:32.296131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff (ip 10.222.0.60) !!! Aug 09 12:55:32.301936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:32.302718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:32.311392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:32.312050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:32.312927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:32.313805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:32.314385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:32.314921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:32.457087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:32.460620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:32.469853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-72edcc09-532e-4233-8409-fe5127ee67b6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.176277 Aug 09 12:55:32.470406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1025/2045] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:32 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:32.777317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:32.778276 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:32.786376 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:32.786853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:32.787286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:32.787965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:32.788422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:32.788856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:32.855151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:32.863179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-494ddc63-bb40-4905-86d3-0ba628774a40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092330 Aug 09 12:55:32.863741 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1021/2046] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:32 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:33.493074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:33.493775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:33.502083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:33.502585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:33.502986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:33.503665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:33.504113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:33.504564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:33.645425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:33.658279 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5a09c40c-6a58-4e18-aa43-83e19b5b6dcd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.169798 Aug 09 12:55:33.659156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1026/2047] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:33 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:33.888846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:33.889791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:33.896758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:33.897239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:33.897666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:33.898351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:33.898801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:33.899216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:33.961299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:33.969396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c530e3b8-060d-413b-ad42-bc8c2171f9c7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087152 Aug 09 12:55:33.969959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1022/2048] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:33 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:34.687609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:34.688167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:34.695513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:34.695993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:34.696408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:34.697130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:34.697579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:34.697995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:34.831899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:34.840560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-391ec940-4f6e-40b4-a271-2d5ebc85de5b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.158922 Aug 09 12:55:34.841141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1027/2049] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:34 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:34.994138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:34.995134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:35.004014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:35.004526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:35.004959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:35.005650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:35.006107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:35.006508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:35.075827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:35.084188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c92c002-d2f7-48ab-8d7e-baab42adaa9f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096673 Aug 09 12:55:35.084790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1023/2050] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:34 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:35.866656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:35.867703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:35.878966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:35.879768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:35.880503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:35.881697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:35.882451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:35.883158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:36.018345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:36.031116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2d24d0f-4bd7-4a9e-ad18-81791c990cc0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171039 Aug 09 12:55:36.032006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1028/2051] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:35 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:36.105247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:36.105846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:36.112704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:36.113179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:36.113606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:36.114286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:36.114730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:36.115145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:36.188027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:36.200737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6efdc7f3-2e02-46aa-9939-7bb2b0722eba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099113 Aug 09 12:55:36.201615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1024/2052] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:36 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:37.062133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:37.062806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:37.070764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:37.071319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:37.071821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:37.072668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:37.073204 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:37.073695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:37.215295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:37.223591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-505a4afd-1fd3-4fd2-be18-4f36ea2faea9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.168196 Aug 09 12:55:37.224191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1029/2053] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:37 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:37.227938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:37.228584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:37.235639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:37.236114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:37.236581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:37.237267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:37.237716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:37.238131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:37.306583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:37.316357 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ee95c7f-4d5f-43ec-921e-d95d9b4a523a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092408 Aug 09 12:55:37.316980 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1025/2054] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:37 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:55:38.248888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:38.250129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:38.261591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:38.262335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:38.263107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:38.264215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:38.265154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:38.265572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:38.337600 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:38.338243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:38.345336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:38.345823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:38.346225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:38.346954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:38.347398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:38.347817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:38.422165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:38.430386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-74a30bb7-9290-49a9-b921-25fc561bf748 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096853 Aug 09 12:55:38.430997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1026/2055] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:38 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:38.432917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:38.441339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4e6efcd-584f-446f-9e93-cafc0cd14da5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.199159 Aug 09 12:55:38.441873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1030/2056] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:38 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:39.456627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:39.457777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:39.466769 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:39.468062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:39.468961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:39.469443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:39.469882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:39.470587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:39.471044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:39.471471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:39.474947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:39.475429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:39.475859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:39.476594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:39.477033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:39.477456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:39.555591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:39.563355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1fb5e08d-5a7a-41da-8f26-949a58dcc6af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.113582 Aug 09 12:55:39.563901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1027/2057] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:39 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:39.624049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:39.632888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83aaa871-14cb-4cbc-abcd-f3dba294294a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172740 Aug 09 12:55:39.633429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1031/2058] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:39 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:40.588626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:40.589632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:40.600525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:40.601331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:40.602052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:40.603189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:40.603946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:40.604697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:40.655766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:40.656905 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:40.667581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:40.668263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:40.669020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:40.670173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:40.671007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:40.671476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:40.680023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:40.688332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-31faf311-4fb5-4b48-ad96-d0f76c4b111d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.106191 Aug 09 12:55:40.688940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1028/2059] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:40 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:41.071240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:41.081100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e171d56b-d1a8-4648-84fe-526adc582709 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.430590 Aug 09 12:55:41.081679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1032/2060] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:40 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:41.710638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:41.711263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:41.718454 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:41.718925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:41.719372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:41.720045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:41.720519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:41.720945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:41.781706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:41.789460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3f8ae076-4d6d-4203-a545-ee636244b2c6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.083365 Aug 09 12:55:41.789967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1029/2061] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:41 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:42.106771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:42.107585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:42.115382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:42.115869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:42.116307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:42.117038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:42.117491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:42.117913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:42.254954 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:42.263612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-379f0c83-866d-48ed-8fc8-24f2968234d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.163570 Aug 09 12:55:42.264160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1033/2062] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:42 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:42.817159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:42.818206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:42.821877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:42.829654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:42.830127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:42.830552 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:42.831236 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:42.831708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:42.832115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:42.898427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:42.906662 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c03f308f-f5fa-4d05-8669-1d79d846ae25 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096420 Aug 09 12:55:42.907229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1030/2063] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:42 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:43.289472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:43.290438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:43.298997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:43.299481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:43.299914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:43.300651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:43.301103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:43.301527 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:43.428335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:43.436687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f3db60d8-f292-4750-bd06-641c5437612f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.154104 Aug 09 12:55:43.437396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1034/2064] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:43 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:43.928219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:43.928857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:43.935667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:43.936144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:43.936681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:43.937371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:43.937828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:43.938253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:44.013631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:44.025567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d4f8afdb-cd15-4ec8-bc0d-7289832db97a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101013 Aug 09 12:55:44.026338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1031/2065] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:43 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:44.464563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:44.465240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:44.472714 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:44.473198 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:44.473628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:44.474327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:44.474782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:44.475236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:44.607857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:44.616752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a9067121-c74d-4438-8d7b-dae39e6605a7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.156651 Aug 09 12:55:44.617331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1035/2066] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:44 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:45.050682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:45.051342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:45.058398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:45.058903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:45.059331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:45.060019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:45.060490 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:45.060912 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:45.128425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:45.136740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-84fcd65e-b34a-4fe7-b514-d02f50a15c52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091662 Aug 09 12:55:45.137298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1032/2067] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:45 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:45.642654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:45.643277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:45.646072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:45.652327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:45.652919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:45.653417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:45.654249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:45.654773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:45.655260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:45.790062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:45.798469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-33aa2769-7dfc-46c8-839f-435f12dedd12 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.161939 Aug 09 12:55:45.799048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1036/2068] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:45 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:46.159095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:46.159756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:46.167221 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:46.167794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:46.168239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:46.169059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:46.169557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:46.170017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:46.258996 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:46.269728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8ebbe3b1-179b-45f1-a84c-4490ebb1b4a6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.115685 Aug 09 12:55:46.270321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1033/2069] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:46 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:46.824290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:46.825329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:46.836860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:46.837663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:46.838383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:46.839521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:46.840245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:46.841032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:46.978229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:46.986858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca4c225c-0990-42ed-8ecf-5afbea1e6088 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.169316 Aug 09 12:55:46.987439 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1037/2070] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:46 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:47.293318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:47.294088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:47.301960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:47.302433 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:47.302858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:47.303536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:47.304005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:47.304420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:47.377299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:47.385591 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d00659d-35eb-49b1-8177-f614eaf1cc69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097502 Aug 09 12:55:47.386156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1034/2071] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:47 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:48.012855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:48.013902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:48.022162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:48.022656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:48.023089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:48.023789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:48.024245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:48.024701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:48.157655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:48.166183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d1e49e05-60c1-49e9-9a57-27c0100b6d15 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.160063 Aug 09 12:55:48.166721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1038/2072] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:48 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:48.417913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:48.418905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:48.429815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:48.430627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:48.431338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:48.432457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:48.433279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:48.433982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:48.496944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:48.505656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f70e5434-dc15-4a40-9cd6-b311a17b86be tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094255 Aug 09 12:55:48.506165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1035/2073] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:48 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:49.190746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:49.191330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:49.198964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:49.199495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:49.199969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:49.200759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:49.201254 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:49.201729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:49.350416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:49.362649 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f31c0c3-7e72-4eda-9dc9-5e5302ea0534 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.177741 Aug 09 12:55:49.363219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1039/2074] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:49 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:49.534387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:49.535373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:49.546305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:49.547100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:49.547953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:49.548914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:49.549364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:49.549787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:49.564123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:49.612658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:49.623991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3e46ad33-ce2c-4e44-985b-3dcd978ec714 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096210 Aug 09 12:55:49.624752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1036/2075] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:49 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:50.388629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:50.389590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:50.400907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:50.401750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:50.402468 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:50.403613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:50.404363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:50.405110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:50.534647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:50.543224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5c69860-8edf-4af0-87f7-1134a510d993 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.161184 Aug 09 12:55:50.543791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1040/2076] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:50 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:50.650004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:50.650732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:50.660161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:50.660686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:50.661116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:50.661813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:50.662273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:50.662699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:50.735617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:50.743728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e3e23acf-71b0-4ad7-836a-e52b90a98a74 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100483 Aug 09 12:55:50.744300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1037/2077] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:50 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:51.569146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:51.570138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:51.581318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:51.581798 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:51.582234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:51.582922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:51.583379 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:51.583797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:51.716438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:51.729406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1c8f7c7f-f17b-41f7-b321-05339a9aa5f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167432 Aug 09 12:55:51.730315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1041/2078] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:51 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:51.767796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:51.768417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:51.775437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:51.775928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:51.776361 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:51.777095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:51.777550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:51.777974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:51.840100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:51.848672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b124d3c7-a7e0-4745-9e4e-7f2165e3a22d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.086976 Aug 09 12:55:51.849238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1038/2079] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:51 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:52.757990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:52.759051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:52.771146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:52.771946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:52.772712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:52.773852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:52.774651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:52.775291 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:52.793912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:52.868977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:52.869612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:52.876868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:52.877439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:52.877901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:52.878599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:52.879046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:52.879465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:52.915587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:52.924652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf41fd5b-cb98-435f-b6d3-78808faa1fc7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.173076 Aug 09 12:55:52.925235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1042/2080] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:52 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:52.943762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:52.952320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bce7784b-da3f-4a2a-8573-a32cc0047552 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087248 Aug 09 12:55:52.952968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1039/2081] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:52 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:53.947996 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:53.948881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:53.957937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:53.958423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:53.958864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:53.959558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:53.960011 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:53.960434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:53.973134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:53.973733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:53.980489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:53.980972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:53.981397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:53.982087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:53.982532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:53.982948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:54.055274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:54.062778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-899c5655-7af8-4010-8cac-dcf4511a9d2c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093647 Aug 09 12:55:54.063379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1040/2082] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:53 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:54.119432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:54.128283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc38bb9b-2b75-4b66-ace0-75bbfeb9b3b7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.186003 Aug 09 12:55:54.128931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1043/2083] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:53 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:55.086586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:55.087220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:55.094896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:55.095440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:55.096135 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:55.096846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:55.097305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:55.097730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:55.151938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:55.152496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:55.161136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:55.161611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:55.162037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:55.162717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:55.163159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:55.163572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:55.170024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:55.177731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d3841442-7d9a-44b2-b046-253581ef8387 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095352 Aug 09 12:55:55.178304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1041/2084] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:55 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:55.293129 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:55.301676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-83f3d9b1-b172-4eb3-89fa-4994f0a4d5cf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.155556 Aug 09 12:55:55.302217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1044/2085] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:55 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:56.202930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:56.203817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:56.211476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:56.211954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:56.212399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:56.213087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:56.213531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:56.213956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:56.279179 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:56.286924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c4486b37-045e-4e04-8ff7-b79e051c35da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090805 Aug 09 12:55:56.287495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1042/2086] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:56 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:56.323010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:56.323733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:56.330572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:56.331052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:56.331478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:56.332158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:56.332637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:56.333053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:56.473170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:56.481303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-465a2851-68c3-4bed-a8f9-5b9cabb8e80c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.162213 Aug 09 12:55:56.481852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1045/2087] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:56 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:57.312108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:57.313382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:57.320985 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:57.321466 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:57.321890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:57.322574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:57.323021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:57.323437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:57.392762 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:57.400769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8ee8231a-cbd7-440c-a439-cffa53fa9585 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095211 Aug 09 12:55:57.401337 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1043/2088] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:57 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:57.508812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:57.509816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:57.519762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:57.520252 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:57.520721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:57.521413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:57.521874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:57.522299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:57.654136 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:57.662414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2b2ec961-dbe9-458a-aa3c-afbf8041ac43 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.161087 Aug 09 12:55:57.662981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1046/2089] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:57 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:58.425621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:58.426219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:58.433067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:58.433635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:58.434089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:58.434796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:58.435238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:58.435649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:58.497031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:58.505243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e36c88a-8ac1-400a-beae-3a973a12c75c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.085577 Aug 09 12:55:58.505808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1044/2090] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:58 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:58.687189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:58.687846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:58.695435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:58.695920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:58.696352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:58.697081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:58.697532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:58.697955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:58.848317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:58.856894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9b245b4e-ea6b-4006-a236-1fd4921ffaa9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.176485 Aug 09 12:55:58.857467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1047/2091] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:58 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:59.530605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:59.531176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:59.539211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:59.539699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:59.540134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:59.540863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:59.541316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:59.541744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:59.610194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:55:59.622499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-52b51d05-3800-4dc7-a225-71d4f403b54d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097823 Aug 09 12:55:59.623480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1045/2092] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:59 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:55:59.883515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:55:59.884371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:55:59.894781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:59.895268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:59.895695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:55:59.896417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:55:59.896871 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:55:59.897297 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:00.035929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:00.048261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-202764bf-b97c-4011-aed5-69993f7080d8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.172233 Aug 09 12:56:00.049163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1048/2093] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:55:59 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:00.647924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:00.648686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:00.657202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:00.657806 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:00.658422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:00.659443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:00.660000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:00.660558 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:00.732157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:00.740277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fbf90a87-c926-43cb-b224-7450595a030e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097556 Aug 09 12:56:00.740881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1046/2094] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:00 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:01.074580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:01.075599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:01.086457 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:01.087419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:01.088155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:01.089360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:01.090118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:01.090831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:01.242625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:01.251024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9a9b4ced-f1c3-4c10-bec5-2596682f93e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.182975 Aug 09 12:56:01.251953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1049/2095] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:01 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:01.765637 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:01.766708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:01.777910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:01.778700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:01.779443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:01.780639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:01.781393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:01.782104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:01.846620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:01.855228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c87b47bc-7f20-4dd8-8b06-04602be0fb6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096153 Aug 09 12:56:01.855789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1047/2096] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:01 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:02.273311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:02.273898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:02.280928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:02.281407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:02.281840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:02.282537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:02.282985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:02.283993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:02.429293 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:02.437667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-14b89933-655c-413a-84f9-a9dc08ae3fda tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.168298 Aug 09 12:56:02.438230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1050/2097] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:02 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:02.880408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:02.881389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:02.893108 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:02.893595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:02.894027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:02.894720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:02.895174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:02.895585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:02.967516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:02.975859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a4c4d106-407e-499f-a65d-5a38ee48119e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102690 Aug 09 12:56:02.976407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1048/2098] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:02 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:03.469010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:03.470130 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:03.477526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:03.478009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:03.478441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:03.479137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:03.479590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:03.480012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:03.609641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:03.617744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cfd7d4f3-acd9-4e09-ab92-22399f382674 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.155246 Aug 09 12:56:03.618322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1051/2099] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:03 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:04.004411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:04.005001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:04.012188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:04.012708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:04.013148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:04.013841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:04.014324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:04.014749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:04.077464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:04.085596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7ff6f4c6-3c2c-4275-a4d2-90787f39993c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087589 Aug 09 12:56:04.086161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1049/2100] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:03 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:04.644002 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:04.645077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:04.656644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:04.657452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:04.658182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:04.659355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:04.659810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:04.660242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:04.806296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:04.814990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9bb98975-05b5-4bbf-ace5-ed164f77a325 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.177536 Aug 09 12:56:04.815912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1052/2101] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:04 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:05.111071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:05.112043 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:05.119483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:05.119966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:05.120410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:05.121133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:05.121601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:05.122015 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:05.190024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:05.198080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d5134c97-25ab-480b-88b9-964de1e3a134 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093625 Aug 09 12:56:05.198647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1050/2102] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:05 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:05.840849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:05.841790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:05.852713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:05.853568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:05.854274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:05.855400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:05.856138 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:05.856874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:06.003955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:06.016906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-572e44d2-7076-4fa1-86cc-aedad85e45cc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.182530 Aug 09 12:56:06.017760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1053/2103] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:05 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:06.229886 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:06.230720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:06.241539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:06.242330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:06.243496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:06.244659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:06.245411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:06.246104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:06.313920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:06.322082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2bdc789a-51c7-4870-9e35-06913ec3daac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098964 Aug 09 12:56:06.322638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1051/2104] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:06 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:07.042568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:07.043499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:07.053558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:07.054319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:07.054990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:07.056057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:07.056804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:07.057579 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:07.197493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:07.205637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6f4766ad-4a4e-4f93-8f3d-14cefcf57117 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.169222 Aug 09 12:56:07.206179 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1054/2105] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:07 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:07.347267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:07.348232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:07.359185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:07.360005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:07.360841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:07.362058 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:07.362907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:07.363331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:07.425898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:07.433919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9a06bd06-6a3a-4a71-aca9-aab8f60c17ed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093343 Aug 09 12:56:07.434481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1052/2106] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:07 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:08.231092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:08.231981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:08.243267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:08.244039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:08.244840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:08.245986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:08.246739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:08.247451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:08.391597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:08.399793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-70762117-26c3-4f04-a56d-fda1f82dd819 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.175384 Aug 09 12:56:08.400364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1055/2107] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:08 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:08.464308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:08.465057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:08.474358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:08.475016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:08.475676 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:08.476780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:08.477464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:08.478109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:08.481801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:08.548153 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:08.556527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-98efbf63-43fa-45f1-9a92-7abe383b9d6f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097897 Aug 09 12:56:08.557121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1053/2108] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:08 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:09.432753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:09.433752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:09.443361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:09.443848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:09.444283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:09.445260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:09.445731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:09.446159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:09.578761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:09.579460 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:09.585445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:09.587069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:09.587533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:09.587987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:09.588793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:09.589244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:09.589668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:09.593789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f869f24e-69f0-470b-9785-077c96462f6d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167631 Aug 09 12:56:09.594402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1056/2109] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:09 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:09.655256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:09.663550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dedafd7a-c68b-4b2a-8c38-5e8dfc47e131 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088727 Aug 09 12:56:09.664128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1054/2110] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:09 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:10.620139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:10.621276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:10.631223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:10.631700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:10.632132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:10.632853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:10.633303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:10.633727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:10.688841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:10.689380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:10.695791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:10.696274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:10.696736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:10.697481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:10.697905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:10.698324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:10.770967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:10.778931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b30823ea-acdd-40f3-a025-069bc1326039 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094086 Aug 09 12:56:10.779494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1055/2111] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:10 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:10.796788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:10.805083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-af7e0718-a6dd-4e59-a29d-216c2e4188d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.191623 Aug 09 12:56:10.805646 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1057/2112] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:10 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:11.803630 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:11.804510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:11.815864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:11.816351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:11.816784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:11.817482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:11.817941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:11.818347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:11.827379 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:11.827988 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:11.834729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:11.835193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:11.835625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:11.836338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:11.837387 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:11.837387 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:11.890592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:11.898489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a41f455f-3dac-48e2-b031-3f381fa6e14e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101487 Aug 09 12:56:11.899068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1056/2113] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:11 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:11.977955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:11.987626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8c8152b-00c9-4823-960c-cefef72ef954 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.164163 Aug 09 12:56:11.988188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1058/2114] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:11 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:12.919698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:12.920303 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:12.922641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:12.928254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:12.928738 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:12.929170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:12.929865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:12.930308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:12.930728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:12.997825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:13.006406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6eee0067-f68e-40fd-ba16-d6f4553695ce tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090632 Aug 09 12:56:13.006970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1057/2115] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:12 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:13.009320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:13.009932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:13.016345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:13.016879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:13.017320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:13.018019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:13.018475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:13.018983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:13.021742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:13.180908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:13.190985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9c0d5219-1794-4003-a338-2c39d081a1f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.185555 Aug 09 12:56:13.192111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1059/2116] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:13 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:14.031318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:14.032306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:14.040870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:14.041360 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:14.041788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:14.042476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:14.042927 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:14.043346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:14.107109 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:14.115411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9cab7a43-9330-44af-92a1-0bcc5842ca26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090663 Aug 09 12:56:14.115976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1058/2117] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:14 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:14.221883 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:14.222751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:14.229953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:14.230466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:14.230934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:14.231668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:14.232151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:14.232645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:14.373295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:14.386546 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a7f877fc-8b22-4ac1-a382-b1fa2094e924 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171097 Aug 09 12:56:14.387413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1060/2118] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:14 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:15.141113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:15.142017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:15.149689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:15.150173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:15.150604 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:15.151298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:15.151746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:15.152167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:15.215247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:15.223164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c96c4e00-de1d-4b75-9a32-9ace631ef6bb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088629 Aug 09 12:56:15.223725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1059/2119] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:15 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:15.415030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:15.415918 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:15.426497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:15.426975 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:15.427416 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:15.428112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:15.428608 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:15.429032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:15.571655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:15.580119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40ceefe8-e830-42d3-8425-f49a7915259a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171743 Aug 09 12:56:15.580726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1061/2120] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:15 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:16.245480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:16.246133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:16.254365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:16.254849 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:16.255290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:16.256005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:16.256475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:16.256898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:16.335411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:16.347873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ebf0101d-d75a-4e32-a06b-08473d8e0495 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.107191 Aug 09 12:56:16.348479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1060/2121] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:16 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:16.601859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:16.602425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:16.604691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:16.610803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:16.611281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:16.611710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:16.612406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:16.612948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:16.613489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:16.776629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:16.785219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-08664efc-9734-46e0-be8b-17266aac5be9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.187113 Aug 09 12:56:16.785731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1062/2122] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:16 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:17.376972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:17.377859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:17.388819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:17.389613 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:17.390317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:17.391329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:17.392065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:17.392804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:17.459515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:17.467475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-55868ffc-db3d-4dfd-94fa-d83416cc19c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094950 Aug 09 12:56:17.468017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1061/2123] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:17 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:17.811554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:17.812564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:17.821486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:17.821975 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:17.822407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:17.823109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:17.823560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:17.823981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:17.967077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:17.975571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d8e4b03a-9a50-46ee-9468-c34ed026a2f3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170478 Aug 09 12:56:17.976119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1063/2124] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:17 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:18.488625 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:18.489233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:18.495823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:18.496328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:18.496805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:18.497473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:18.497922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:18.498324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:18.560233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:18.568813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73ba043c-d2ce-46c2-9638-622e13ea2d48 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.084204 Aug 09 12:56:18.569389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1062/2125] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:18 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:19.001328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:19.002371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:19.013658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:19.014460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:19.015232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:19.016429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:19.017185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:19.017904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:19.168690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:19.177396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-160ee973-050d-4d92-b8c2-0471d060d7e6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.183152 Aug 09 12:56:19.178020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1064/2126] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:18 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:19.594634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:19.595690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:19.607716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:19.608555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:19.609273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:19.610404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:19.611143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:19.611852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:19.674187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:19.682859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-97ac0bfb-1cee-4588-808d-d1e400095669 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095149 Aug 09 12:56:19.683437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1063/2127] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:19 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:20.204772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:20.206031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:20.216901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:20.217694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:20.218400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:20.219529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:20.220274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:20.221017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:20.363420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:20.372506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a592484d-088e-4cd6-9d32-e91b99b69921 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.174880 Aug 09 12:56:20.373056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1065/2128] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:20 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:20.708277 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:20.709342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:20.720094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:20.720962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:20.721668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:20.722789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:20.723529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:20.724339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:20.791176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:20.802784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a1c15521-1a3c-4868-8564-5aeb9848f592 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100752 Aug 09 12:56:20.803616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1064/2129] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:20 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:21.398033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:21.399012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:21.409724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:21.410532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:21.411120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:21.412284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:21.413094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:21.413744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:21.548984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:21.561144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-22d386e3-41d2-48fd-b071-93ea4166985b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.169326 Aug 09 12:56:21.561922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1066/2130] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:21 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:21.832860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:21.833986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:21.840913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:21.841396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:21.841818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:21.842501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:21.842943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:21.843355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:21.908362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:21.916523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b8bc5075-1167-466e-ad82-d9506590d283 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090229 Aug 09 12:56:21.917079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1065/2131] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:21 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:22.588405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:22.589161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:22.597752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:22.598353 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:22.598980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:22.600034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:22.600642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:22.601173 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:22.740219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:22.747858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-130e271f-6be4-4b56-b512-4c3be10ba32c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.164872 Aug 09 12:56:22.748413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1067/2132] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:22 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:22.940922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:22.941543 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:22.949523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:22.950001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:22.950431 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:22.951118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:22.951564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:22.951984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:23.017653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:23.028925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6a2791f3-a2a4-4a41-9519-50ca802ecb59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093718 Aug 09 12:56:23.029783 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1066/2133] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:22 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:23.779564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:23.780526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:23.790438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:23.790917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:23.791345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:23.792020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:23.792507 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:23.792920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:23.936052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:23.944813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-95e7d4e0-d5a5-45ca-8d17-4424a902d0d0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.171713 Aug 09 12:56:23.945427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1068/2134] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:23 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:24.055206 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:24.055820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:24.064293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:24.064937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:24.065470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:24.066363 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:24.066923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:24.067444 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:24.307418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:24.319399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ced88568-f16a-4e69-a114-bc4f52907634 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.270667 Aug 09 12:56:24.320621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1067/2135] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:24 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:24.968524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:24.969405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:24.978595 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:24.979236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:24.979813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:24.980767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:24.981376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:24.981934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:25.120091 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:25.128857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0f63d481-53d2-45e8-a4f4-e25b84c7996a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.165536 Aug 09 12:56:25.129427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1069/2136] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:24 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:25.350286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:25.351297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:25.359386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:25.359949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:25.360480 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:25.361274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:25.361798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:25.362291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:25.433403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:25.441089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d10df318-b18b-4936-a9f5-b063303ffc90 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097161 Aug 09 12:56:25.441652 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1068/2137] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:25 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:26.154789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:26.155651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:26.165158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:26.165679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:26.166107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:26.166783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:26.167227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:26.167668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:26.315693 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:26.328998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0207dcb-80df-4f70-a264-62a6ed4e8df2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.181045 Aug 09 12:56:26.329823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1070/2138] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:26 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:26.465209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:26.465889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:26.472721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:26.473204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:26.473631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:26.474318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:26.474772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:26.475192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:26.537239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:26.539782 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:26.546742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ee2f0083-02aa-46b4-a3cf-8a337ab61b79 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.086184 Aug 09 12:56:26.547394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1069/2139] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:26 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:27.355079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:27.355720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:27.362822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:27.363321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:27.363770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:27.364528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:27.364995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:27.365432 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:27.498983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:27.507640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0c9b634d-7b71-4f15-b001-20db758d58c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.157568 Aug 09 12:56:27.508417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1071/2140] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:27 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:27.568973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:27.569542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:27.576872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:27.577354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:27.577822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:27.578512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:27.578925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:27.579340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:27.644142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:27.652350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0a1e65cb-da8d-4ad3-826b-83e5562c5b69 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087229 Aug 09 12:56:27.652943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1070/2141] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:27 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:28.530183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:28.530737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:28.537447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:28.537920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:28.538351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:28.539026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:28.539477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:28.540013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:28.681553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:28.681553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:28.683708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:28.688545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:28.689037 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:28.689469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:28.690170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:28.690623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:28.691046 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:28.692055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-750fc351-74db-416c-a2fa-fc68c5b7c81a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.165907 Aug 09 12:56:28.692685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1072/2142] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:28 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:28.765691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:28.775928 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-504be55b-bc54-4eb6-bf51-b4b1d971541e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101303 Aug 09 12:56:28.776535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1071/2143] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:28 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:29.714467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:29.715033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:29.721859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:29.722339 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:29.722761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:29.723435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:29.723887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:29.724306 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:29.804708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:29.805514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:29.812091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:29.812602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:29.813031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:29.813719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:29.814165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:29.814612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:29.882188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:29.890068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c51caea9-8922-48a2-a64f-c25506192d89 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089295 Aug 09 12:56:29.890885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1072/2144] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:29 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:29.895165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:29.904939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f309fbc9-e72f-48cf-b68c-e46d185699db tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.194049 Aug 09 12:56:29.905694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1073/2145] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:29 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:30.910491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:30.911104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:30.918033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:30.918513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:30.918944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:30.919654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:30.920101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:30.920551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:30.925993 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:30.926565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:30.933426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:30.933966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:30.934403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:30.935096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:30.935550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:30.935970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:30.994306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:31.002525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1f4cafe4-94d3-4feb-ba39-8e3aa3bc2d52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095957 Aug 09 12:56:31.003089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1073/2146] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:30 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:31.080780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:31.090127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f85115a5-1306-4ef3-b63a-56879bb4d003 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167973 Aug 09 12:56:31.090702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1074/2147] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:30 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:32.028797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:32.029748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:32.039659 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:32.040139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:32.040608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:32.041309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:32.041756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:32.042158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:32.104441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:32.111118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:32.111718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:32.112396 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-532ad34d-18ee-4d3b-b173-80438c8492d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090299 Aug 09 12:56:32.112993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1074/2148] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:32 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:32.118132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:32.118615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:32.119046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:32.119744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:32.120191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:32.120627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:32.253890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:32.256095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:32.263626 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52d1d013-fc63-454f-80d8-c6c310595a18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.156326 Aug 09 12:56:32.264201 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1075/2149] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:32 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:33.142908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:33.143701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:33.150853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:33.151341 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:33.151773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:33.152505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:33.152961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:33.153382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:33.225715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:33.234087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c4cd8d6d-dc32-4680-b051-6ceacfa2bb5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096471 Aug 09 12:56:33.234657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1075/2150] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:33 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:33.287101 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:33.287675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:33.294463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:33.294945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:33.295370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:33.296052 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:33.296535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:33.296952 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:33.449425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:33.457788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3b074d30-3c02-43a3-981a-3a28d4c2359e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.174603 Aug 09 12:56:33.458354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1076/2151] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:33 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:34.263895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:34.264945 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:34.275908 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:34.276802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:34.277525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:34.278635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:34.279415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:34.280119 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:34.345594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:34.353747 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-988da00a-0479-43b3-8870-63f532fff61a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096567 Aug 09 12:56:34.354307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1076/2152] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:34 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:34.480696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:34.481310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:34.488202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:34.488719 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:34.489158 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:34.489842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:34.490301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:34.490727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:34.637381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:34.645866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6d77623f-dcd5-4964-95a7-1e5186382c6f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.169520 Aug 09 12:56:34.646450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1077/2153] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:34 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:35.379288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:35.380283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:35.391298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:35.392095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:35.392861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:35.393995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:35.394745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:35.395487 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:35.459211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:35.467439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2519c9ee-d607-450e-aad5-2f4dff0b1691 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095142 Aug 09 12:56:35.468010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1077/2154] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:35 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:35.671641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:35.672543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:35.683120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:35.683934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:35.684763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:35.685997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:35.686679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:35.687400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:35.827309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:35.841206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3556f7a1-1ccd-4cb3-8ee7-81061c86b782 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.175882 Aug 09 12:56:35.841964 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1078/2155] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:35 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:36.487834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:36.488436 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:36.495514 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:36.495993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:36.496411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:36.497136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:36.497582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:36.498002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:36.562938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:36.571231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a6b3b1c8-309c-4fbe-bf8d-c587e4e98622 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087355 Aug 09 12:56:36.571802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1078/2156] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:36 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:36.870642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:36.871528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:36.880897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:36.881555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:36.882179 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:36.883437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:36.883893 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:36.884501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:37.035125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:37.046497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ff4d2baf-a5ed-403a-b349-90039afd760c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.181641 Aug 09 12:56:37.047154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1079/2157] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:36 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:37.598497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:37.599134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:37.606485 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:37.606966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:37.607397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:37.608103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:37.608589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:37.609012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:37.676554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:37.685322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b003ee89-a8b5-4b4a-89b0-308165f5d1a1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090775 Aug 09 12:56:37.686311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1079/2158] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:37 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:38.073819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:38.074560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:38.082864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:38.083446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:38.083982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:38.084866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:38.085426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:38.085951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:38.231117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:38.243438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-149cbd8e-9674-4dea-b814-f39bf940b693 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.175133 Aug 09 12:56:38.244041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1080/2159] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:38 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:38.715247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:38.715918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:38.723975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:38.724610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:38.725130 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:38.725955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:38.726509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:38.727601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:38.790358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:38.798264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d1af5532-3cd8-4668-ba06-f0322299276e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088448 Aug 09 12:56:38.798852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1080/2160] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:38 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:39.266113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:39.266795 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:39.274598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:39.275070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:39.275501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:39.276180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:39.276658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:39.277061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:39.418724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:39.427140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1d036b52-e535-48de-bdab-1d6304675b97 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.165676 Aug 09 12:56:39.427708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1081/2161] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:39 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:39.824423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:39.825421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:39.836781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:39.837305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:39.837742 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:39.838437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:39.838890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:39.839308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:39.907828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:39.916093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b520f88a-46e6-443a-8e28-8f03de245828 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098681 Aug 09 12:56:39.916685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1081/2162] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:39 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:40.452441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:40.454110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:40.463415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:40.463898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:40.464337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:40.465069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:40.465521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:40.465947 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:40.604077 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:40.616548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-da568730-f92b-4c5c-9859-b7c5586f5f5a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.170668 Aug 09 12:56:40.617670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1082/2163] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:40 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:40.937191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:40.937794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:40.944704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:40.945178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:40.945650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:40.946442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:40.946892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:40.947310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:41.010210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:41.018104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0611cedd-9d84-49e8-8226-132bf394468d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.084884 Aug 09 12:56:41.018673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1082/2164] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:40 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:41.638944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:41.639552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:41.646122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:41.646596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:41.647023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:41.647707 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:41.648225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:41.648679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:41.799599 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:41.811588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-63abf5ea-9717-4eb2-af5f-f4be019d4b9f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.176276 Aug 09 12:56:41.812552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1083/2165] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:41 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:42.047335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:42.047918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:42.055386 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:42.056122 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:42.056524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:42.057362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:42.057813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:42.058238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:42.128819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:42.137259 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b9bb240b-c7ec-4276-8f06-1381da06249d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094049 Aug 09 12:56:42.137856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1083/2166] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:42 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:42.839860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:42.840594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:42.847726 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:42.848249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:42.848796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:42.849554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:42.850049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:42.850512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:42.988034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:42.996786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ad244a28-e491-4550-aea1-295fbd916054 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.161865 Aug 09 12:56:42.997337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1084/2167] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:42 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:43.162282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:43.162827 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:43.169497 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:43.173306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:43.173788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:43.174220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:43.174916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:43.175349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:43.175764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:43.241863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:43.250113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d308225a-45ec-4bf2-9bd0-b0ffad75988d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091942 Aug 09 12:56:43.250672 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1084/2168] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:43 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:44.023496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:44.025144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:44.035922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:44.036768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:44.037477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:44.038610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:44.039776 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:44.039908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:44.189668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:44.201257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8a9e5f0-f5bd-4948-9b41-b41efd3da22c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.184323 Aug 09 12:56:44.201832 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1085/2169] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:44 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:44.272708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:44.273351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:44.280212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:44.280752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:44.281194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:44.281892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:44.282349 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:44.282777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:44.345094 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:44.352812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-69dfd192-7e2b-4b68-bac5-a984b4fefe29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.084007 Aug 09 12:56:44.353379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1085/2170] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:44 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:45.228093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:45.228746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:45.238163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:45.238852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:45.239476 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:45.240631 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:45.241299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:45.241895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:45.374971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:45.375609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:45.383939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:45.384612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:45.385153 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:45.386308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:45.386881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:45.387354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:45.405753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:45.420834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:45.431007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f50f9298-3a1a-4d03-bbe3-1a3710d9e4fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.207615 Aug 09 12:56:45.431600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1086/2171] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:45 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:45.459766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:45.472790 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-03e2c160-ee4e-4b15-ac09-c60141eba000 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102538 Aug 09 12:56:45.473721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1086/2172] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:45 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:56:46.460890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:46.461936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:46.468897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:46.469379 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:46.469816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:46.470520 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:46.470976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:46.471397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:46.501670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:46.502326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:46.509371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:46.509846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:46.510272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:46.510957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:46.511400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:46.511813 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:46.589623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:46.599544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-34aedeaf-d320-4b73-82bc-74f278ed44b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102396 Aug 09 12:56:46.600410 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1087/2173] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:46 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:46.646350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:46.654934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb3d4419-dbe8-4ea2-97d1-29243b9a60c6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.200599 Aug 09 12:56:46.655561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1087/2174] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:46 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:47.631248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:47.632275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:47.639941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:47.640414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:47.640877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:47.641576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:47.642016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:47.642441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:47.676561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:47.677154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:47.679671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:47.685107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:47.685601 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:47.686040 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:47.686744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:47.687197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:47.687634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:47.707446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:47.715470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-730404ec-426c-4299-90bb-118305838119 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091118 Aug 09 12:56:47.716044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1088/2175] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:47 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:47.824983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:47.837187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c818a010-de6b-4c7a-8efa-ae628c90efd7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.164306 Aug 09 12:56:47.837955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1088/2176] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:47 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:48.742111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:48.743417 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:48.750314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:48.751136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:48.751571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:48.752262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:48.752748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:48.753166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:48.824692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:48.835144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-948ce6c4-7325-494e-b793-a09b6f24d340 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099603 Aug 09 12:56:48.835787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1089/2177] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:48 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:48.858558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:48.859390 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:48.866828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:48.867753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:48.868241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:48.869071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:48.869551 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:48.869974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:49.031962 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:49.040761 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c0038b4-d107-46dd-b295-15ae027dbcc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.186108 Aug 09 12:56:49.041337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1089/2178] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:48 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:49.858017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:49.858870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:49.866903 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:49.867458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:49.867934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:49.868673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:49.869137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:49.869546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:49.949723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:49.960256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e738467-b63a-4b05-95c5-99635bc23ab6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.106328 Aug 09 12:56:49.965887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1090/2179] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:49 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:50.063114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:50.063701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:50.070794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:50.071419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:50.071886 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:50.072638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:50.073120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:50.073532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:50.211178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:50.219792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-02682e10-45bd-429f-b9ba-3ef64177187c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.160602 Aug 09 12:56:50.220362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1090/2180] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:50 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:50.986814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:50.987690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:50.996484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:51.002973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:51.003916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:51.004666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:51.005120 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:51.005540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:51.077789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:51.085697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-adc8e2fb-2993-47b1-add7-688ec6387def tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.104388 Aug 09 12:56:51.086336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1091/2181] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:50 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:51.244889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:51.245513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:51.253305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:51.253817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:51.254275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:51.254948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:51.255400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:51.255820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:51.396519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:51.405092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-64497985-139a-4c70-acbf-52c02b9ed3b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.167307 Aug 09 12:56:51.405708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1091/2182] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:51 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:52.115382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:52.116397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:52.128413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:52.129312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:52.130045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:52.131160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:52.132016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:52.132798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:52.206803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:52.219561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4b72bd1f-09c2-4ac4-9d8a-649b691756c2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.110142 Aug 09 12:56:52.220816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1092/2183] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:52 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:52.433828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:52.434896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:52.445778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:52.446270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:52.446711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:52.447412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:52.447881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:52.448295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:52.463859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:56:52.593438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:52.601652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62315934-5818-4509-a586-b7c61ff1d46d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.174438 Aug 09 12:56:52.602421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1092/2184] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:52 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:53.247563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:53.248267 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:53.256974 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:53.257571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:53.258107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:53.259346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:53.259920 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:53.260450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:53.326017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:53.334364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-44899d92-36c7-4955-9d7e-f8bcc3a87c66 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092167 Aug 09 12:56:53.334953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1093/2185] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:53 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:53.627542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:53.628352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:53.637178 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:53.637665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:53.638102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:53.638802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:53.639255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:53.639682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:53.790510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:53.799277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c135a1d7-a928-46f5-9ae9-e7d7f2d97f02 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.178818 Aug 09 12:56:53.799855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1093/2186] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:53 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:54.357997 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:54.358698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:54.366879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:54.367441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:54.367943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:54.368873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:54.369574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:54.370064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:54.441017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:54.450588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8399eab5-c45e-4342-ac56-ed64ff35a813 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097222 Aug 09 12:56:54.451159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1094/2187] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:54 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:54.829508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:54.830097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:54.837081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:54.837897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:54.838329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:54.839013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:54.839463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:54.839877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:54.981867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:54.990497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5db5b896-6165-482a-943a-901a63c8aa18 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.165108 Aug 09 12:56:54.991097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1094/2188] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:54 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:55.474976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:55.476072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:55.487736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:55.488585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:55.489311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:55.490435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:55.491196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:55.491896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:55.555660 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:55.564910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-598028ec-1476-42d2-9975-5c320bae1e2a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096530 Aug 09 12:56:55.565521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1095/2189] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:55 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:56.013939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:56.014544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:56.021758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:56.022245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:56.022675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:56.023371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:56.023821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:56.024240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:56.162938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:56.171755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ba2cc3f0-6910-4032-9981-f824625eb70e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.161809 Aug 09 12:56:56.172410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1095/2190] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:56 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:56.590661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:56.591668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:56.602648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:56.603443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:56.604150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:56.605434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:56.606015 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:56.606418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:56.677859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:56.686352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-315a0fd1-b3c8-45e7-9153-5fd212e5d576 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102656 Aug 09 12:56:56.686902 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1096/2191] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:56 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:57.196981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:57.198123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:57.210868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:57.211800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:57.212530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:57.213743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:57.214512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:57.215061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:57.359001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:57.371428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4f142846-9a4d-400d-bdc1-7bc30ced5927 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.180494 Aug 09 12:56:57.372168 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1096/2192] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:57 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:57.715160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:57.715841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:57.723339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:57.723879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:57.724356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:57.725153 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:57.725656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:57.726128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:57.789275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:57.797353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9c3bf48b-d7ef-4097-b260-e7f28583eaae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088544 Aug 09 12:56:57.797909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1097/2193] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:57 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:58.402968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:58.403733 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:58.412221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:58.412884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:58.413425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:58.414276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:58.414837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:58.415402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:58.553633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:58.562502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5d22148b-87b2-4649-8fd3-270442903cc4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166726 Aug 09 12:56:58.564544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1097/2194] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:58 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:58.823443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:58.824405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:58.831264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:58.831746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:58.832176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:58.832897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:58.833345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:58.833760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:58.896608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:58.904670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dc4ab271-bec0-4ef9-9e28-84381bf6abdc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087587 Aug 09 12:56:58.905225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1098/2195] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:58 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:59.588159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:59.589188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:59.600029 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:59.600871 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:59.601585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:59.602701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:59.603448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:59.604137 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:59.741808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:56:59.750450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-88331ff7-d8ac-4df4-a60a-79524ab45a49 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.168740 Aug 09 12:56:59.751368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1098/2196] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:59 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:56:59.926466 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:56:59.927150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:56:59.934128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:59.934615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:59.935048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:56:59.935745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:56:59.936197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:56:59.936661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:00.001971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:00.009696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4599a7b4-7387-47ab-b2bd-1f04ecd1b8f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087206 Aug 09 12:57:00.010268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1099/2197] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:56:59 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:00.776302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:00.777487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:00.784226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:00.784749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:00.785183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:00.785874 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:00.786326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:00.786749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:00.925979 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:00.934573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ac1c5a6e-1ed1-4a92-ba53-5206fc8d53f9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.164698 Aug 09 12:57:00.935148 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1099/2198] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:00 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:01.033510 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:01.034204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:01.042840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:01.043351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:01.043772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:01.044498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:01.044947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:01.045364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:01.110250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:01.118607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dd3b612e-42df-4d09-939a-a1b45acf403a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090463 Aug 09 12:57:01.119212 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1100/2199] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:01 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:01.958908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:01.959788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:01.970139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:01.970868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:01.971521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:01.972614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:01.973299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:01.973936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:02.119402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:02.128668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf1f3789-4e84-4a5d-92e6-98dc70abdd35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.175646 Aug 09 12:57:02.129318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1100/2200] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:01 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:02.139150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:02.140312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:02.147305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:02.147715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:02.148170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:02.148883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:02.149362 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:02.149779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:02.213476 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:02.224960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5b20e302-5144-41ef-bce0-6f8fdb025d84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089555 Aug 09 12:57:02.225534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1101/2201] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:02 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:03.150879 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:03.151424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:03.158362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:03.158846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:03.159289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:03.159981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:03.160447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:03.160894 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:03.246987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:03.247597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:03.255051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:03.255528 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:03.255961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:03.256776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:03.257231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:03.257644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:03.293823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:03.301937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5172628a-fed9-437b-8980-eb4dde383515 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.155387 Aug 09 12:57:03.302549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1101/2202] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:03 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:03.321500 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:03.329448 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-651ff5f3-20c5-4a70-81ca-4170a8cfee3b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087516 Aug 09 12:57:03.330012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1102/2203] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:03 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:04.325864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:04.326590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:04.334286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:04.334857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:04.335420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:04.336226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:04.336801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:04.337302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:04.349566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:04.350158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:04.357129 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:04.357610 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:04.358036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:04.358734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:04.359180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:04.359599 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:04.362189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:04.436724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:04.444585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-95231207-0fa4-416a-9340-353416addad2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098856 Aug 09 12:57:04.445175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1103/2204] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:04 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:04.496611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:04.505202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ce13c15-e5f7-452e-a3a3-204fe1d2d5c9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.185516 Aug 09 12:57:04.505788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1102/2205] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:04 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:05.469366 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:05.470031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:05.477291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:05.477830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:05.478319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:05.479086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:05.479595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:05.480262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:05.527430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:05.528100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:05.534976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:05.535456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:05.535887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:05.536621 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:05.537082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:05.537502 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:05.547381 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:05.555733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ce65cb4-3456-4ea5-80ec-437398b51f7a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091947 Aug 09 12:57:05.556334 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1104/2206] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:05 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:05.674263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:05.682838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f2692d6b-6cd9-4760-a9c1-d97836bebaba tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.159276 Aug 09 12:57:05.683645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1103/2207] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:05 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:57:06.578162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:06.578748 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:06.586036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:06.586512 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:06.586938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:06.587618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:06.588062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:06.588508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:06.654926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:06.663026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-98436961-50c1-49e4-b304-76ee3d9829a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089186 Aug 09 12:57:06.663598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1105/2208] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:06 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:06.707561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:06.708128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:06.715046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:06.715523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:06.715953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:06.716671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:06.717120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:06.717539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:06.857161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:06.865677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cc356e8d-bd7e-4e49-991e-99ca34b22114 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.162014 Aug 09 12:57:06.866250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1104/2209] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:06 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:07.688217 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:07.688969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:07.697857 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:07.698473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:07.699012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:07.699872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:07.700451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:07.701018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:07.769194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:07.780619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-369a1fdd-ac2f-483d-a96a-9e044cbaad70 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098926 Aug 09 12:57:07.781339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1106/2210] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:07 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:07.890889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:07.891281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:07.898559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:07.899075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:07.899559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:07.900413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:07.900927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:07.901399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:08.304200 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:08.313723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-01b01936-0307-4ef3-9bda-ef9e1d2c224d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.429065 Aug 09 12:57:08.314305 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1105/2211] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:07 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:08.809479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:08.810185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:08.820607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:08.821331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:08.821953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:08.823001 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:08.823865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:08.824494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:08.886621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:08.896154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3bbb5e9a-06f3-4dda-9a41-8bfcd3a85982 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092768 Aug 09 12:57:08.896745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1107/2212] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:08 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:09.338304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:09.339294 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:09.350456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:09.351269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:09.351974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:09.353149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:09.353897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:09.354596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:09.489821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:09.498224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-037de02d-0fc0-4f7b-816a-5d418a013310 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.166442 Aug 09 12:57:09.498801 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1106/2213] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:09 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:09.918197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:09.918691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:09.925607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:09.926092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:09.926520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:09.927199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:09.927665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:09.928083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:09.994538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:10.003079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0d75c0c5-3851-403c-9eb2-f310c8a60fad tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089029 Aug 09 12:57:10.003642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1108/2214] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:09 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:10.196690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:57:10.197003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:57:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:57:10.520121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:10.520770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:10.527960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:10.528463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:10.528898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:10.529576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:10.530027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:10.530445 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:10.660269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:10.668924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4410168-7764-442e-9228-d01fdc8c0fdc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1558 microversion: 2.1 time: 0.152929 Aug 09 12:57:10.669489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1107/2215] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:10 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:11.023403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:11.024007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:11.032211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:11.032703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:11.033344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:11.034025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:11.035608 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:11.035982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:11.126513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:11.139814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7e8eddfd-9de1-481a-989e-2394a0797baa tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.120106 Aug 09 12:57:11.142132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1109/2216] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:11 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:11.431413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [req-4681448c-1e6b-4803-bf14-5871e2f51722 req-2215aa41-15a7-4b85-a4d5-a535ce688d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6409e8d1-b827-4649-83ea-b853a1f203ff", "name": "network-vif-deleted", "tag": "9853ae88-f914-498a-ad3c-5291035573bc"}]} {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 12:57:11.441328 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4681448c-1e6b-4803-bf14-5871e2f51722 req-2215aa41-15a7-4b85-a4d5-a535ce688d7c service nova] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:11.441804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4681448c-1e6b-4803-bf14-5871e2f51722 req-2215aa41-15a7-4b85-a4d5-a535ce688d7c service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:11.442240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [req-4681448c-1e6b-4803-bf14-5871e2f51722 req-2215aa41-15a7-4b85-a4d5-a535ce688d7c service nova] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:11.453355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.compute.server_external_events [req-4681448c-1e6b-4803-bf14-5871e2f51722 req-2215aa41-15a7-4b85-a4d5-a535ce688d7c service nova] Creating event network-vif-deleted:9853ae88-f914-498a-ad3c-5291035573bc for instance 6409e8d1-b827-4649-83ea-b853a1f203ff on hv-cinder-85236 Aug 09 12:57:11.458473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [req-4681448c-1e6b-4803-bf14-5871e2f51722 req-2215aa41-15a7-4b85-a4d5-a535ce688d7c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030778 Aug 09 12:57:11.459049 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1108/2217] 10.222.0.60 () {64 vars in 1317 bytes} [Tue Aug 9 12:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 12:57:11.699340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:11.699865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:11.706270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:11.706751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:11.707159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:11.707873 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:11.708319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:11.708777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:11.772192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:11.780344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0968b60a-8e5d-4741-90b9-a3399bdd7abb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.087613 Aug 09 12:57:11.780933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1110/2218] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:11 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:12.010565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:57:12.010860 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:57:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:57:12.170203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:12.171360 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:12.181904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:12.182888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:12.183370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:12.184059 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:12.184544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:12.184969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:12.252160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:12.254515 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:12.261401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-10c06757-f66a-49db-a624-fb517780524b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099065 Aug 09 12:57:12.261899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1109/2219] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:12 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:12.805989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:12.806992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:12.814210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:12.814686 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:12.815112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:12.815795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:12.816238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:12.816684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:12.886544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:12.895279 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bfa0f4d6-4fc7-418e-be28-a0f7e6d43cf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.095781 Aug 09 12:57:12.895880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1111/2220] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:12 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:13.286315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:13.287320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:13.295898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:13.296395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:13.296838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:13.297526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:13.297981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:13.298402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:13.366172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:13.374813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-835a25a9-35dd-4a69-8581-4c6ea1c9f5ea tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095299 Aug 09 12:57:13.375378 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1110/2221] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:13 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:13.917131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:13.917723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:13.920048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=56 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:13.925525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:13.926002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:13.926434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:13.927116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:13.927560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:13.927973 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:13.993588 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:14.008013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-63fa73d3-a138-4aa9-ad38-9f7f0a77aac8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.094484 Aug 09 12:57:14.008930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1112/2222] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:13 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:14.403862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:14.404480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:14.411381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:14.411858 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:14.412281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:14.412992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:14.413436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:14.413852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:14.478262 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:14.490679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-19445526-e8a5-4f15-b7fb-6b5c80449859 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090732 Aug 09 12:57:14.491471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1111/2223] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:14 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:15.035991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:15.037013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:15.048198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:15.049040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:15.049752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:15.050880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:15.051626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:15.052316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:15.114934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:15.123072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b1ad3a95-ddc1-4258-96b6-605093b76ccb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.093535 Aug 09 12:57:15.123628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1113/2224] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:15 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:15.516997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:15.517692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:15.525828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:15.526679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:15.527342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:15.528207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:15.528803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:15.529325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:15.597514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:15.605389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-35ed07a0-261e-4894-8771-a0dce5539526 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093655 Aug 09 12:57:15.605946 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1112/2225] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:15 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:16.148461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:16.149324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:16.160418 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:16.161187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:16.161950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:16.163088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:16.163891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:16.164611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:16.235964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:16.247999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-14963ecc-c0db-4e96-b950-3fa4eb43a748 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.106312 Aug 09 12:57:16.248584 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1114/2226] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:16 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:16.629888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:16.630469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:16.641043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:16.641836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:16.642581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:16.643721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:16.644417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:16.644835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:16.719983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:16.728012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2e517781-7f11-4d26-b2d7-39e71a409b64 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102838 Aug 09 12:57:16.730107 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1113/2227] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:16 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:17.270717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:17.271331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:17.281107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:17.281595 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:17.282093 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:17.282822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:17.283274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:17.283691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:17.369048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:17.381255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c100c1ef-4029-45fb-a067-370518d4ef3f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.114817 Aug 09 12:57:17.381963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1115/2228] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:17 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:17.759337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:17.760403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:17.763196 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=52 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:17.768514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:17.768994 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:17.769419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:17.770075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:17.770534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:17.770948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:17.840679 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:17.851784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2c08e0a0-43ae-4526-a714-29921d5d053a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098830 Aug 09 12:57:17.852505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1114/2229] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:17 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:18.405177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:18.406030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:18.415201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:18.416086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:18.416938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:18.417739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:18.418191 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:18.418614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:18.490803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:18.499861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d09863ef-480b-4e14-bf64-d6cc7c0906c4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.099343 Aug 09 12:57:18.500424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1116/2230] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:18 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:18.872710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:18.873383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:18.880591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:18.881226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:18.881665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:18.882370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:18.882822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:18.883244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:18.948538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:18.956372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dc8bc445-4705-4230-8334-d860eaa1717e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087760 Aug 09 12:57:18.956971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1115/2231] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:18 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:19.523530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:19.524147 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:19.531622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:19.532115 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:19.532578 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:19.533262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:19.533705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:19.534123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:19.604002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:19.612438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce200892-3f1b-4d79-9350-345f4e47a3e0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.095372 Aug 09 12:57:19.613019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1117/2232] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:19 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:19.983131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:19.983734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:19.990926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:19.991417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:19.991854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:19.992585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:19.993055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:19.993463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:20.062790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:20.070523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ea01388b-75fc-474a-892f-d05ca8add83b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094416 Aug 09 12:57:20.071085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1116/2233] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:19 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:20.637775 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:20.638760 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:20.645946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:20.646432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:20.646868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:20.647527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:20.648009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:20.648462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:20.717734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:20.726254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-160ab0c4-cf8a-4954-b450-df9a69ad7e50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.095126 Aug 09 12:57:20.726799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1118/2234] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:20 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:21.093697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:21.094370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:21.101226 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:21.101716 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:21.102142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:21.102824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:21.103295 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:21.103730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:21.178037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:21.190363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b3f5b36e-708d-4684-b554-64c596962811 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101914 Aug 09 12:57:21.191210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1117/2235] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:21 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:21.752696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:21.753295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:21.760651 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:21.761168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:21.761619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:21.762345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:21.762818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:21.763264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:21.828016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:21.830292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:21.837836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ac750ac-19d9-42f1-8bff-a81327ea3f40 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.090983 Aug 09 12:57:21.838413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1119/2236] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:21 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:22.220243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:22.221141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:22.232056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:22.232929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:22.233645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:22.234667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:22.235116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:22.235535 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:22.298592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:22.306614 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d8dfc29d-a898-4056-a951-c404f0b613c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093061 Aug 09 12:57:22.307180 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1118/2237] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:22 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:22.863380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:22.864137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:22.871914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:22.872517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:22.873023 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:22.873816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:22.874336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:22.874825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:22.940249 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:22.948355 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7993a9a9-97e1-45de-b1bb-b3311f91e749 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.091976 Aug 09 12:57:22.949086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1120/2238] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:22 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:23.331362 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:23.331948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:23.338970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:23.339447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:23.339873 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:23.340596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:23.341046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:23.341463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:23.413413 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:23.421461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-466d2e1e-3bb4-4765-977e-2907d1ad9043 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096508 Aug 09 12:57:23.422019 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1119/2239] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:23 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:23.971428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:23.972057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:23.979228 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:23.979714 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:23.980138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:23.980854 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:23.981302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:23.981739 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:24.045726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:24.054063 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b090c19b-2d9b-482d-8dea-e97dc69671f1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.086670 Aug 09 12:57:24.054642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1121/2240] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:23 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:24.445938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:24.446730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:24.456039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:24.456763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:24.457348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:24.458260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:24.459348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:24.459725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:24.526658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:24.534752 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e936451b-8132-4c10-9be0-9dcb97e51c67 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095379 Aug 09 12:57:24.535323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1120/2241] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:24 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:25.079546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:25.080828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:25.089271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:25.089749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:25.090182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:25.090863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:25.091307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:25.091725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:25.154489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:25.163022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4c6f85a0-b0ef-4779-aa2c-738e0482b2a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.090033 Aug 09 12:57:25.163579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1122/2242] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:25 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:25.558219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:25.558804 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:25.565827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:25.566311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:25.566744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:25.567409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:25.567877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:25.568299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:25.639848 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:25.647878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-40071e94-df10-4c7a-8761-0533a57c6cb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095170 Aug 09 12:57:25.648453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1121/2243] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:25 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:26.185661 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:26.186288 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:26.192620 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:26.193112 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:26.193554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:26.194331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:26.194753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:26.195203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:26.259243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:26.267477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-220fac77-2d05-4f44-b277-9528336633f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.086432 Aug 09 12:57:26.268012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1123/2244] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:26 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:26.670063 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:26.670647 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:26.676972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:26.677448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:26.677881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:26.678565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:26.679008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:26.679430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:26.751121 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:26.761545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-becf25c8-d6bc-41bc-bc1c-190af5f144bd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096125 Aug 09 12:57:26.762122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1122/2245] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:26 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:27.291905 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:27.292557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:27.299155 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:27.299639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:27.300075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:27.300798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:27.301250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:27.301669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:27.362898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:27.371066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4134782e-151c-480b-a24a-f2a299ca2863 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.084838 Aug 09 12:57:27.371638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1124/2246] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:27 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:27.786747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:27.787727 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:27.798562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:27.799348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:27.800060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:27.801229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:27.801965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:27.802671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:27.869921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:27.878414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e557d7cb-ae4e-47e9-9c76-1f9179bf488a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098314 Aug 09 12:57:27.878978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1123/2247] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:27 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:27.962161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:57:27.962530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:57:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:57:28.396867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:28.397896 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:28.405924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:28.406405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:28.406835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:28.407530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:28.408080 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:28.408549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:28.473293 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:28.482036 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5ab64f01-d452-4e53-bb03-94fa3dac3cb9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.091696 Aug 09 12:57:28.482597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1125/2248] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:28 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:28.902156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:28.902896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:28.912794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:28.913337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:28.913955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:28.914959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:28.915854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:28.916278 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:28.986610 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:28.998240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6051776c-7657-45be-b713-8e5562c768a2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102586 Aug 09 12:57:28.998982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1124/2249] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:28 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:29.507885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:29.508926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:29.520102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:29.520952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:29.521666 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:29.522786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:29.523534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:29.524233 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:29.593195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:29.602067 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0ddfdd1a-cfca-4f42-9e6e-223a68609c32 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.101724 Aug 09 12:57:29.602609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1126/2250] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:29 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:30.024215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:30.024938 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:30.032009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:30.032524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:30.032956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:30.033638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:30.034082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:30.034503 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:30.109177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:30.117010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f177d4e1-ebe6-45f3-bb06-4c32d9d9ff71 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097092 Aug 09 12:57:30.117573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1125/2251] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:30 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:30.628010 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:30.629051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:30.640282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:30.641176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:30.641884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:30.643050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:30.643752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:30.644459 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:30.709346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:30.717649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-40e6915c-f509-4347-9041-8d201e2ad1dd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.096884 Aug 09 12:57:30.718210 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1127/2252] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:30 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:31.142885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:31.143766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:31.154435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:31.155221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:31.155930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:31.157094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:31.157846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:31.158537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:31.176787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:31.225975 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:31.234461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fed9d879-02cb-4523-b06d-508adad25763 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098164 Aug 09 12:57:31.235055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1126/2253] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:31 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:31.741377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:31.742264 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:31.752464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:31.753159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:31.753778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:31.754735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:31.755374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:31.755968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:31.819759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:31.828371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0cbd304a-fa0e-4e96-a896-19c93bb6f12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.092897 Aug 09 12:57:31.829002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1128/2254] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:31 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:32.255778 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:32.256352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:32.264085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:32.264802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:32.265404 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:32.266430 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:32.267055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:32.267667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:32.357580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:32.368415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f45d96c5-ce41-4156-a49e-5727fb3f9e4f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.116596 Aug 09 12:57:32.369018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1127/2255] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:32 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:32.852737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:32.853840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:32.865013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:32.865818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:32.866561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:32.867706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:32.868438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:32.869205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:32.936749 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:32.948719 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e6b191c4-7aba-4535-8616-ea298354b65f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.102409 Aug 09 12:57:32.949573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1129/2256] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:32 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:33.392115 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:33.392782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:33.399916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:33.400412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:33.400969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:33.401683 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:33.402153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:33.402591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:33.470749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:33.479134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-aacf123c-c09d-4ebb-b358-061f90e31e83 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091688 Aug 09 12:57:33.479713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1128/2257] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:33 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:33.980587 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:33.981924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:33.989407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:33.989847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:33.990255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:33.991100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:33.991593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:33.992040 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:34.065836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:34.074375 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9f9a897e-d221-40f2-8b44-dbde88c4886f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.100683 Aug 09 12:57:34.074965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1130/2258] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:33 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:34.501717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:34.502319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:34.509342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:34.509819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:34.510265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:34.510985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:34.511440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:34.511855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:34.584188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:34.592495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ac31d92-e02d-43c9-ada8-2422a0bf4be3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095938 Aug 09 12:57:34.593060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1129/2259] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:34 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:35.103820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:35.104451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:35.114728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:35.115365 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:35.115961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:35.117035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:35.117626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:35.118176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:35.187006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:35.199085 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-042bb325-af28-4afc-bc13-561f19b65910 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.105749 Aug 09 12:57:35.199835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1131/2260] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:35 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:35.613667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:35.614396 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:35.621215 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:35.621708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:35.622122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:35.622875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:35.623486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:35.623742 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:35.693491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:35.702176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a574debb-5d0b-463a-9b32-ebbe58c99a17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092321 Aug 09 12:57:35.702737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1130/2261] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:35 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:36.226858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:36.227426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:36.234407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:36.234906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:36.235333 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:36.236009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:36.236466 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:36.236902 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:36.301509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:36.313837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a09772a-fa0d-4988-95d7-27f47002ab50 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.090706 Aug 09 12:57:36.314616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1132/2262] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:36 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:36.727662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:36.728700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:36.739713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:36.740675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:36.741284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:36.742418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:36.743166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:36.743871 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:36.810525 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:36.818343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6cf4d41a-1093-4a5b-a0f1-869b7022fab1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097209 Aug 09 12:57:36.818966 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1131/2263] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:36 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:37.341900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:37.342716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:37.349601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:37.350095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:37.350530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:37.351222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:37.351674 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:37.352099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:37.413976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:37.422014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-418b7fa9-b330-4146-927e-35a80e31945b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.086114 Aug 09 12:57:37.422567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1133/2264] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:37 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:37.842953 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:37.843859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:37.855064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:37.855853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:37.856606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:37.857982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:37.858113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:37.858545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:37.920807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:37.928510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2bb21ca8-418d-4f0e-97e2-ba022040e1cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092129 Aug 09 12:57:37.929061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1132/2265] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:37 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:38.447225 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:38.448248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:38.456106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:38.456635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:38.457069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:38.457774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:38.458214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:38.458634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:38.527154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:38.535533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ff6631fc-8080-45b5-b2bf-b2a4863278e9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.094934 Aug 09 12:57:38.536104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1134/2266] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:38 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:38.953233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:38.954172 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:38.964999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:38.965772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:38.966536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:38.968229 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:38.968851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:38.969550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:39.045814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:39.057917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa1fe60c-7ffe-4bfa-b4f5-d2c507f555cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.110825 Aug 09 12:57:39.058721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1133/2267] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:38 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:39.560898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:39.561455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:39.568301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:39.568816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:39.569252 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:39.569943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:39.570394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:39.570814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:39.632313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:39.640705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c444008b-18d7-4ea5-87db-a2dae85d3482 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.086078 Aug 09 12:57:39.641269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1135/2268] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:39 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:40.083819 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:40.084828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:40.096087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:40.096955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:40.097669 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:40.098806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:40.099540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:40.100234 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:40.179482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:40.191078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2263b7c9-cd8f-4685-ac09-705c9b875f45 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.113820 Aug 09 12:57:40.191911 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1134/2269] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:40 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:40.664763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:40.665935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:40.674639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:40.675141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:40.675579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:40.676270 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:40.676758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:40.677182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:40.692671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:40.747855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:40.756614 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-598d3b71-9a76-4ba5-b67f-df3f4cea0dfa tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.098398 Aug 09 12:57:40.757194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1136/2270] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:40 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:41.224471 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:41.225253 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:41.235244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:41.235937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:41.236594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:41.237562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:41.238205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:41.238805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:41.320081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:41.328930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-16a4013a-d768-40aa-bd55-404fb95f56c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.110293 Aug 09 12:57:41.329545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1135/2271] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:41 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:57:41.777818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:41.778364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:41.785486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:41.785970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:41.786400 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:41.787086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:41.787534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:41.787954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:41.858076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:41.866667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-263eac44-b5e0-4f68-a59c-e8bfc1e97101 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.092904 Aug 09 12:57:41.867235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1137/2272] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:41 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:42.354701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:42.355767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:42.363003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:42.363519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:42.363955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:42.364663 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:42.365113 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:42.365530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:42.427582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:42.438782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-65001975-7342-4aab-adae-c93d98dbe1dc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090529 Aug 09 12:57:42.439321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1136/2273] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:42 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:42.892183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:42.893224 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:42.903931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:42.904767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:42.905286 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:42.905975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:42.906423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:42.906838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:42.977193 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:42.985883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3ce79e76-ae30-413e-9f55-8a10721e75c3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.100150 Aug 09 12:57:42.986449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1138/2274] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:42 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:43.463882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:43.464816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:43.472739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:43.473227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:43.473654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:43.474344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:43.474789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:43.475212 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:43.549007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:43.557203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f213b9f-d457-4a46-9821-5c1bde059d47 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100470 Aug 09 12:57:43.557758 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1137/2275] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:43 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:44.008773 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:44.009529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:44.012451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:44.019022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:44.019501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:44.019935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:44.020644 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:44.021098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:44.021505 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:44.087835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:44.096593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e93f1e2f-e0fa-4da2-bc8e-c18545224775 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.092497 Aug 09 12:57:44.097184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1139/2276] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:44 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:44.579428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:44.580008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:44.587036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:44.587519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:44.587951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:44.588668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:44.589122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:44.589541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:44.661620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:44.672956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e39193fe-c0c6-4edd-97d5-77ea7e0836ac tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098237 Aug 09 12:57:44.673522 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1138/2277] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:44 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:45.122132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:45.122892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:45.131165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:45.131724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:45.132181 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:45.133012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:45.133509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:45.134000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:45.216314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:45.228988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5c4f85b4-2396-4108-9283-8e5763854889 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.113740 Aug 09 12:57:45.229890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1140/2278] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:45 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:45.695554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:45.696155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:45.706159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:45.706824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:45.707857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:45.709676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:45.710580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:45.711232 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:45.791932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:45.800651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bc2250c6-4dfb-47eb-8c3b-654d98780a85 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.109432 Aug 09 12:57:45.801203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1139/2279] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:45 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:46.250966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:46.251556 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:46.259003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:46.259488 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:46.259915 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:46.260653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:46.261103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:46.261523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:46.331889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:46.344170 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ae817b6d-9001-4976-b124-f2d0ba98fcf7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.097223 Aug 09 12:57:46.344979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1141/2280] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:46 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:46.829512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:46.830656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:46.840119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:46.840863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:46.841511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:46.842541 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:46.843220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:46.843852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:46.919324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:46.930284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-df9d2c88-8465-4d15-9fd9-56fc50269d1d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.110648 Aug 09 12:57:46.931120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1140/2281] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:46 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:47.365946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:47.366612 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:47.373199 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:47.373682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:47.374119 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:47.374810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:47.375569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:47.375995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:47.447258 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:47.457458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b070a73b-5630-4964-882c-b4a5961e25e2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.095564 Aug 09 12:57:47.458021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1142/2282] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:47 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:47.954823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:47.955732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:47.959347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:47.967680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:47.968359 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:47.969089 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:47.970192 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:47.970936 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:47.971788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:48.047241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:48.056125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2a0bda86-4b9f-4a6b-b43d-fcf48d60cd32 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.106213 Aug 09 12:57:48.056734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1141/2283] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:47 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:48.493250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:48.493872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:48.502301 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:48.502990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:48.503530 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:48.504239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:48.504721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:48.505143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:48.581535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:48.589821 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ae5b35c8-5701-430d-9cd2-694a68d972dc tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.102716 Aug 09 12:57:48.590384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1143/2284] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:48 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:49.079890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:49.080574 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:49.087488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:49.087978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:49.088422 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:49.089133 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:49.089592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:49.090020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:49.166616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:49.179458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bf77b185-c2cf-4540-a09a-5247e4eac22f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.105092 Aug 09 12:57:49.180273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1142/2285] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:49 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:49.614158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:49.614753 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:49.621998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:49.622482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:49.622907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:49.623593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:49.624039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:49.624489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:49.693776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:49.702146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c7a5676-f9d4-4521-a472-0f3df94ede35 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.093318 Aug 09 12:57:49.702707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1144/2286] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:49 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:50.206150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:50.206695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:50.216256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:50.216968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:50.217461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:50.218435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:50.219000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:50.219555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:50.222767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:50.303582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:50.313676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-936ab77c-1915-43e5-bd90-c2021a1e659d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.113934 Aug 09 12:57:50.314277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1143/2287] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:50 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:50.726589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:50.727177 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:50.736423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:50.737069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:50.737918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:50.738635 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:50.739320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:50.739934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:50.819354 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:50.832059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0b1fde54-5dcd-4f0b-9ed6-ca28eafef362 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.108617 Aug 09 12:57:50.832834 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1145/2288] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:50 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:51.334597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:51.335277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:51.342010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:51.342495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:51.342923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:51.343609 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:51.344055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:51.344496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:51.418670 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:51.431820 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bacc6c9c-a498-42c1-ae69-4c11ee956f11 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100999 Aug 09 12:57:51.432543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1144/2289] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:51 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:51.861786 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:51.862369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:51.869322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:51.869800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:51.870235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:51.870887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:51.871336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:51.871752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:51.935439 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:51.944203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6f39b2d9-2896-493f-b4f1-68131ad0fe8b tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.088628 Aug 09 12:57:51.944789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1146/2290] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:51 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:52.456419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:52.457145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:52.464151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:52.464652 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:52.465145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:52.465818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:52.466269 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:52.466701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:52.530852 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:52.538713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3210485c-ea79-454c-87d7-0797f8e3ca75 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.086265 Aug 09 12:57:52.539265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1145/2291] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:52 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:52.973078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:52.973801 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:52.981563 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:52.982148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:52.982634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:52.983475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:52.983982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:52.984450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:53.053968 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:53.062083 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d81043c-89ff-4184-a22d-1b7a1a671326 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.094658 Aug 09 12:57:53.062653 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1147/2292] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:52 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:53.563556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:53.564193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:53.574469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:53.575037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:53.575589 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:53.576488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:53.577123 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:53.577702 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:53.643715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:53.652086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3fc4be7d-dc70-48fb-9530-6bc4d7baab8a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094846 Aug 09 12:57:53.652765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1146/2293] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:53 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:54.085011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:54.085812 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:54.098308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:54.099254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:54.099975 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:54.101171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:54.102031 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:54.102830 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:54.192489 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:54.207272 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-edec2dd8-da0d-4bd3-823f-50de85c6ad17 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.126884 Aug 09 12:57:54.208317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1148/2294] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:54 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:54.674435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:54.675109 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:54.683755 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:54.684331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:54.684840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:54.685650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:54.686117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:54.686620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:54.762337 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:54.771464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d65c3ead-490e-4e73-8dbc-1f348be46895 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101582 Aug 09 12:57:54.772143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1147/2295] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:54 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 12:57:55.234833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:55.235443 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:55.242730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:55.243226 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:55.243667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:55.244434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:55.244865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:55.245313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:55.312956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:55.322098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6d821b9a-e57b-4825-90da-8cba3ea49bb1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.091762 Aug 09 12:57:55.322721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1149/2296] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:55 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:55.795282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:55.795904 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:55.803345 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:55.803830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:55.804274 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:55.805211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:55.805703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:55.806134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:55.877169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:55.885403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1846f069-b9d2-412a-aec3-6ec4e95600ba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094264 Aug 09 12:57:55.886222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1148/2297] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:55 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:56.345933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:56.346531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:56.353922 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:56.354419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:56.354858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:56.355576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:56.356027 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:56.356478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:56.424016 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:56.432862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-68979840-c14e-41e4-aa3d-e275e7216949 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.091149 Aug 09 12:57:56.433589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1150/2298] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:56 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:56.909656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:56.910336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:56.918461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:56.918937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:56.919366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:56.920044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:56.920554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:56.920970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:56.988794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:56.996931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c0828365-5bbd-4c25-9921-e2f0e9b8fefe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093277 Aug 09 12:57:56.997489 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1149/2299] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:56 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:57.457839 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:57.458551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:57.467253 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:57.467704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:57.468161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:57.468883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:57.469330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:57.469745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:57.542451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:57.551554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-81544d11-c749-4dc5-b266-857570e88343 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.100187 Aug 09 12:57:57.552140 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1151/2300] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:57 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:58.023881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:58.024537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:58.031316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:58.031789 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:58.032214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:58.032937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:58.033389 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:58.033799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:58.104927 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:58.113224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2e3f9ade-2286-420a-adbd-5243d7be7eb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093484 Aug 09 12:57:58.113796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1150/2301] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:58 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:58.577993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:58.578764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:58.587592 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:58.588168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:58.588737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:58.589573 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:58.590207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:58.590678 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:58.663707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:58.674885 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f45fb48b-dd39-4ec1-95b4-3530e001843d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.104304 Aug 09 12:57:58.675475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1152/2302] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:58 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:59.135217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:59.135812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:59.144781 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:59.145482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:59.146255 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:59.147391 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:59.148153 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:59.148786 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:59.221427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:59.229791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5b5deb33-4f4c-429e-a59d-ff2d78204765 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098587 Aug 09 12:57:59.230374 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1151/2303] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:59 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:57:59.700428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:57:59.701060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:57:59.708223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:59.708727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:59.709152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:59.709852 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:57:59.710295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:57:59.710699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:57:59.713408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:59.786391 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:57:59.800169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-89f557af-5aff-4e9d-9a96-442f112ccec9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.103312 Aug 09 12:57:59.801106 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1153/2304] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:57:59 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:00.256662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:00.257710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:00.268611 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:00.269236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:00.269748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:00.270627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:00.271183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:00.271751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:00.343700 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:00.355399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-43963b0a-0c69-49e2-8b47-9747b1dd00b8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.106582 Aug 09 12:58:00.356116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1152/2305] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:00 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:00.826900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:00.827444 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:00.835048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:00.835540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:00.835987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:00.836712 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:00.837161 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:00.837583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:00.902794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:00.911535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5e4c68af-275b-4e5a-bba0-601c5c63fabf tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.088736 Aug 09 12:58:00.912104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1154/2306] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:00 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:01.382470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:01.383419 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:01.394554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:01.395349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:01.396068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:01.397261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:01.398025 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:01.398731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:01.467965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:01.477371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20bafc4e-65b7-41db-8bd2-3ff02981b133 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102028 Aug 09 12:58:01.477951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1153/2307] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:01 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:01.935382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:01.936239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:01.945569 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:01.946254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:01.946865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:01.947829 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:01.948509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:01.949145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:02.011819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:02.020295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2aa7734b-77e2-4457-a455-83fbeb9f2d8f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.090403 Aug 09 12:58:02.020904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1155/2308] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:01 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:02.502596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:02.503671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:02.514571 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:02.515375 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:02.516098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:02.523480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:02.523480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:02.523480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:02.583495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:02.591197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-29e28138-4295-4dc9-8620-5bf4b2f28e31 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095671 Aug 09 12:58:02.591757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1154/2309] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:02 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:03.045808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:03.046881 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:03.058285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:03.059082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:03.059804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:03.060986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:03.061730 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:03.062453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:03.125992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:03.134583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ce69ae55-c972-44e3-93ab-13a8dd99f65e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.095446 Aug 09 12:58:03.135114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1156/2310] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:03 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:03.619573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:03.620140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:03.627767 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:03.628246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:03.628710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:03.629401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:03.629853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:03.630276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:03.699518 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:03.707513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a4886aaf-f8e0-4e2f-b745-73f0e3d098e3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091861 Aug 09 12:58:03.708078 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1155/2311] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:03 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:04.161807 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:04.162656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:04.173940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:04.174426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:04.174862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:04.175555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:04.176013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:04.176426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:04.253128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:04.265342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bdf48846-7b9b-44f4-a828-362308e1f6e1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.110768 Aug 09 12:58:04.266035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1157/2312] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:04 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:04.732630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:04.733659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:04.741332 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:04.741846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:04.742289 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:04.742970 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:04.743418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:04.743843 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:04.810500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:04.818281 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e864f532-8190-4f37-a5e0-37d7167732e1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092201 Aug 09 12:58:04.818855 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1156/2313] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:04 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:05.288836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:05.289524 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:05.297483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:05.298051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:05.299088 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:05.299899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:05.300430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:05.300963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:05.368194 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:05.377515 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-928b55f3-4136-432c-8d35-361eb88a6e6a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.093361 Aug 09 12:58:05.378090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1158/2314] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:05 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:05.841877 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:05.842763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:05.852334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:05.853094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:05.853745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:05.854779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:05.855459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:05.856096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:05.926545 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:05.934464 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-42dcae57-7e68-4a5f-be60-f64d6fd8300d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098817 Aug 09 12:58:05.935024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1157/2315] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:05 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:06.407700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:06.409113 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:06.419805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:06.420657 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:06.421378 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:06.422496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:06.423313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:06.423733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:06.495250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:06.507437 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a5893428-0301-4b08-9843-afd28ad48f28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.106316 Aug 09 12:58:06.508111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1159/2316] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:06 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:06.955500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:06.956112 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:06.962923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:06.963409 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:06.963849 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:06.964560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:06.965008 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:06.965456 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:07.027434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:07.035932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5755130f-4044-4b4f-9737-324cae0e9921 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.084384 Aug 09 12:58:07.036504 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1158/2317] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:06 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:07.533060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:07.534137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:07.541308 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:07.541817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:07.542275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:07.542998 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:07.543470 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:07.543916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:07.608234 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:07.616826 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-491026d6-39f9-4984-940b-e447b4920a9a tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.090551 Aug 09 12:58:07.617393 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1160/2318] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:07 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:08.211497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:08.212104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:08.218167 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:08.218654 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:08.219088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:08.219791 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:08.220812 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:08.221239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:08.295763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:08.298021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:08.305111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8cc422b4-6127-44ba-84f6-fd86ecab9437 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.249462 Aug 09 12:58:08.305681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1159/2319] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:08 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:08.639851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:08.640495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:08.647484 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:08.647961 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:08.648420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:08.649098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:08.649547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:08.649964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:08.711260 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:08.719570 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46f58e5d-f94d-46ac-aa64-b1663543fbb5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.083880 Aug 09 12:58:08.720395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1161/2320] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:08 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:09.330903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:09.331606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:09.340065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:09.340711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:09.341249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:09.342102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:09.342665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:09.343191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:09.413746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:09.425074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-babecfd3-d1aa-4454-a9dd-c79b5e8a36e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101278 Aug 09 12:58:09.425638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1160/2321] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:09 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:09.744627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:09.745619 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:09.755187 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:09.755667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:09.756096 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:09.756822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:09.757269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:09.757720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:09.820358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:09.832449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0a0d7007-9862-4cf0-9c2a-c148867be687 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.094070 Aug 09 12:58:09.833241 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1162/2322] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:09 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:10.449739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:10.450660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:10.462268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:10.463094 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:10.463803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:10.464979 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:10.465739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:10.466577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:10.589051 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:10.598641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0914b9fd-d67d-4c23-961f-a833aefc5a91 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.155430 Aug 09 12:58:10.599209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1161/2323] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:10 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:10.857451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:10.858173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:10.866397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:10.866879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:10.867312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:10.867987 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:10.868429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:10.868879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:10.932728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:10.944086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ebd1bfd8-fa9d-43e4-a7d7-2577ba780519 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.093099 Aug 09 12:58:10.944709 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1163/2324] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:10 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:11.623698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:11.624698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:11.635835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:11.636681 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:11.637472 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:11.638582 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:11.639334 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:11.640027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:11.706442 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:11.714214 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0862f1ff-0c69-451b-bc01-fc87d4ffb6f7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097566 Aug 09 12:58:11.714823 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1162/2325] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:11 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:11.968275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:11.969145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:11.978042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:11.978605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:11.979184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:11.980144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:11.980746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:11.981317 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:12.105954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:12.118411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-72ecf43d-616a-4d87-8ad3-9707cfcd81c0 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.156059 Aug 09 12:58:12.118979 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1164/2326] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:11 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:12.739514 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:12.740572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:12.751219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:12.751695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:12.752116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:12.752834 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:12.753280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:12.753691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:12.819760 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:12.831202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d5b9c9af-1042-4e05-a647-61d7c471206a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097846 Aug 09 12:58:12.832154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1163/2327] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:12 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:13.143132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:13.143655 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:13.151024 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:13.151502 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:13.151925 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:13.152648 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:13.153091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:13.153507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:13.218244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:13.226465 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2df92af5-2d3e-487a-a344-75f21c437dab tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.089233 Aug 09 12:58:13.227026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1165/2328] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:13 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:13.861329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:13.861917 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:13.869207 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:13.869590 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:13.870021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:13.870753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:13.871220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:13.871657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:13.935224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:13.943161 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-87d6227d-3b4b-445e-a2ef-8ef7b2cb11b5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088327 Aug 09 12:58:13.943732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1164/2329] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:13 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:14.251594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:14.252195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:14.254718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:14.260990 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:14.261522 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:14.262002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:14.262761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:14.263273 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:14.263736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:14.328605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:14.341059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4aee1f46-7c0e-4e85-bb8f-2a4e6b2fc998 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.096210 Aug 09 12:58:14.341757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1166/2330] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:14 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:14.969901 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:14.970494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:14.977478 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:14.977972 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:14.978410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:14.979102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:14.979559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:14.979984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:15.045425 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:15.055561 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-540b9208-3cc5-4295-b847-509ece01ba88 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091885 Aug 09 12:58:15.056401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1165/2331] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:14 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:15.362302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:15.362906 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:15.369941 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:15.370425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:15.370862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:15.371554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:15.372005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:15.372422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:15.439171 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:15.448683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-77fe1720-8b2d-45b3-9099-224b9cfde9de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.090046 Aug 09 12:58:15.449464 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1167/2332] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:15 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:16.080185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:16.080866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:16.088286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:16.088900 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:16.089385 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:16.090140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:16.090645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:16.091117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:16.159164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:16.166792 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-04ca9fe0-c467-4ff5-b7f2-87e5a088626d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092775 Aug 09 12:58:16.167355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1166/2333] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:16 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:16.473392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:16.473986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:16.481561 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:16.482103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:16.482589 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:16.483359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:16.483861 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:16.484297 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:16.551438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:16.559937 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f301860d-e5ba-479c-b534-49251f678da1 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.092356 Aug 09 12:58:16.560540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1168/2334] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:16 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:17.190272 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:17.190913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:17.205371 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:17.205892 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:17.206436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:17.207140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:17.207596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:17.208076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:17.293317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:17.303149 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67275368-1a0e-48c6-adf5-c5e327aa7fe1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.119321 Aug 09 12:58:17.303724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1167/2335] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:17 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:17.581462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:17.582028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:17.588929 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:17.589438 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:17.589926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:17.590685 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:17.591143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:17.591564 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:17.924292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:17.926703 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:17.934290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8cab0bab-b100-4d04-b5b0-b738bf663f23 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.357189 Aug 09 12:58:17.934910 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1169/2336] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:17 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:18.331750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:18.332537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:18.335481 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:18.342737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:18.343370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:18.343934 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:18.344965 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:18.345807 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:18.346363 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:18.411302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:18.419233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-73d6c870-a23d-4471-b899-5fe5ceb837cc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093490 Aug 09 12:58:18.419808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1168/2337] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:18 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:18.957057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:18.957682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:18.964788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:18.965507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:18.966141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:18.966845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:18.967294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:18.967705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:19.029605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:19.037870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-327ea2cb-23c0-4e22-94d4-8437b9bd9aa2 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.084952 Aug 09 12:58:19.038623 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1170/2338] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:18 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:19.444537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:19.445513 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:19.456597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:19.457588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:19.458317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:19.459500 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:19.460246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:19.460989 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:19.530827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:19.539347 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c51e6f42-7f89-4e5c-b0b0-59d701fd92f3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101622 Aug 09 12:58:19.539958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1169/2339] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:19 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:20.059383 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:20.059957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:20.067050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:20.067535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:20.067966 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:20.068696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:20.069142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:20.069559 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:20.139751 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:20.148368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6f4e33e2-ea6e-4f33-ade6-600e58d5eb01 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.093319 Aug 09 12:58:20.148947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1171/2340] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:20 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:20.567588 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:20.568284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:20.575341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:20.575861 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:20.576323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:20.577085 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:20.577565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:20.578010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:20.803157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:20.811656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-206930f9-ca0b-4542-9516-397c19c541d7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.248134 Aug 09 12:58:20.812235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1170/2341] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:20 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:21.174116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:21.174680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:21.182114 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:21.182656 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:21.183146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:21.183876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:21.184316 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:21.184802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:21.249457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:21.258351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1acb45a8-85b4-4702-8bc1-a2f65ad0e7fd tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.090699 Aug 09 12:58:21.258943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1172/2342] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:21 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:21.838703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:21.839741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:21.848243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:21.848746 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:21.849157 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:21.849898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:21.850342 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:21.850757 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:21.918300 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:21.926463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ca98ca02-965a-43cb-94a9-5c36c468ca52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094325 Aug 09 12:58:21.927021 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1171/2343] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:21 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:22.283539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:22.284133 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:22.291078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:22.291568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:22.292002 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:22.292733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:22.293188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:22.293611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:22.356346 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:22.364689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d3b0566-6c31-4190-872f-c4bbe0fddef8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.086852 Aug 09 12:58:22.365269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1173/2344] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:22 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:22.948423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:22.949124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:22.956737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:22.957267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:22.957771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:22.958526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:22.959038 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:22.959505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:23.027209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:23.035450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-62b23052-f562-471b-8783-6d7173169994 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091374 Aug 09 12:58:23.036061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1172/2345] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:22 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:23.389969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:23.390953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:23.398285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:23.398763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:23.399189 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:23.399872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:23.400315 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:23.400774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:23.462017 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:23.470182 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0f32a0b3-55ab-4eb9-8807-7a8d9eabb12d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.086725 Aug 09 12:58:23.470745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1174/2346] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:23 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:24.064493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:24.065236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:24.073154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:24.073711 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:24.074218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:24.075020 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:24.075550 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:24.076043 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:24.140948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:24.149751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-555b945d-6b79-4eef-8bde-9a82e940e020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092325 Aug 09 12:58:24.150301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1173/2347] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:24 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:24.497151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:24.498152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:24.509815 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:24.510617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:24.511344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:24.512521 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:24.513283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:24.513993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:24.581879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:24.590047 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a9db614c-cb1e-4978-a5b3-e440532f33de tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.099812 Aug 09 12:58:24.590631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1175/2348] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:24 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:25.174618 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:25.175194 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:25.182766 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:25.183320 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:25.183816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:25.184630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:25.185146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:25.185603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:25.250220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:25.258352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-5cee8358-a970-4e4d-999c-dda375be65ee tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089662 Aug 09 12:58:25.258906 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1174/2349] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:25 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:25.620339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:25.621403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:25.630227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:25.630705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:25.631162 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:25.631840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:25.632284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:25.632731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:25.696429 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:25.705192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cf2b730f-b24d-4154-a186-60ac04e01bd3 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.091197 Aug 09 12:58:25.705755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1176/2350] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:25 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:26.280070 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:26.281383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:26.288443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:26.288949 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:26.289407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:26.290100 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:26.290549 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:26.290974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:26.351916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:26.359830 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3e6eb640-d553-4789-a5eb-4e805900b647 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.083704 Aug 09 12:58:26.360399 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1175/2351] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:26 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:26.730370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:26.731190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:26.742025 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:26.742892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:26.743602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:26.744800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:26.745545 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:26.746219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:26.830718 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:26.844021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4a407fa7-f294-4139-a2ea-fb589e99e426 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.120206 Aug 09 12:58:26.845078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1177/2352] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:26 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:27.380570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:27.381211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:27.388367 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:27.388884 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:27.389324 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:27.390015 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:27.390475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:27.390899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:27.409126 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:27.456484 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:27.467340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2f45e121-9f5c-4c24-a5bc-7cc6121e10fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090704 Aug 09 12:58:27.468152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1176/2353] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:27 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:27.868148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:27.868752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:27.876195 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:27.876736 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:27.877186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:27.877899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:27.878369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:27.878807 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:27.941894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:27.950149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46613be0-c337-47f4-8512-4c05668f77a4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.086834 Aug 09 12:58:27.950734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1178/2354] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:27 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:28.494805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:28.495790 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:28.506661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:28.507142 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:28.507577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:28.508264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:28.508750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:28.509169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:28.575392 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:28.583899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-36a5c52d-b19e-4544-b972-13b076a31680 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096550 Aug 09 12:58:28.584493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1177/2355] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:28 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:28.971384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:28.971976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:28.979055 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:28.979540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:28.979971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:28.980690 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:28.981139 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:28.981557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:29.054451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:29.062772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-46d56295-887b-466a-96fe-cc3f9aba0ad8 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.095422 Aug 09 12:58:29.063322 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1179/2356] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:28 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:29.609018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:29.609923 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:29.619122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:29.619601 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:29.620033 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:29.620743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:29.621188 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:29.621598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:29.682242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:29.689960 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0828099b-ccf3-4cc5-b71c-75c49730867f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087491 Aug 09 12:58:29.690525 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1178/2357] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:29 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:30.087238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:30.087824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:30.095014 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:30.095519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:30.095977 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:30.096737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:30.097207 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:30.097668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:30.171457 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:30.180611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1d60a631-2832-4a72-ade8-72f7beb2e8b9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.099744 Aug 09 12:58:30.181169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1180/2358] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:30 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:30.715851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:30.716888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:30.726831 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:30.727309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:30.727738 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:30.728423 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:30.728895 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:30.729312 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:30.791718 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:30.803671 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-104eac4f-c2b4-42c8-b5f2-d52792b277c1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094707 Aug 09 12:58:30.804239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1179/2359] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:30 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:31.207411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:31.207976 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:31.215205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:31.215673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:31.216128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:31.216855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:31.217305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:31.217727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:31.283458 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:31.292856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c0ff26c2-0b59-407e-9fc4-ffe8dc470f87 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.089383 Aug 09 12:58:31.293461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1181/2360] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:31 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:31.826660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:31.827441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:31.839152 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:31.839637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:31.840073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:31.840800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:31.841256 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:31.841682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:31.912563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:31.920641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-20586c34-0017-4e95-8a2f-8ed2ab48f2c0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098978 Aug 09 12:58:31.921200 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1180/2361] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:31 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:32.314795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:32.315527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:32.323039 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:32.323523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:32.323959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:32.324691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:32.325152 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:32.325582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:32.392725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:32.402462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1140079c-fb1d-40be-98e2-42a69087ac93 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.092588 Aug 09 12:58:32.403026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1182/2362] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:32 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:32.943764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:32.944526 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:32.951316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:32.951799 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:32.952225 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:32.952948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:32.953395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:32.953817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:33.024096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:33.035880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f48c7280-8e47-4a87-9f82-bae6df16b350 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097965 Aug 09 12:58:33.037037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1181/2363] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:32 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:33.427423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:33.428340 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:33.439597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:33.440423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:33.441197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:33.442320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:33.443074 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:33.443705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:33.507828 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:33.515948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-291405f6-0e19-4946-acd6-72818ec9047c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.095246 Aug 09 12:58:33.516535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1183/2364] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:33 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:34.063335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:34.064370 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:34.075372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:34.076168 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:34.076944 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:34.078106 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:34.078809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:34.079501 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:34.148108 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:34.159666 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-57487e37-cfa7-4b6b-b1cc-70c5bbf79dbd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102639 Aug 09 12:58:34.160441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1182/2365] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:34 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:34.540803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:34.541784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:34.552632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:34.553425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:34.554202 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:34.554893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:34.555344 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:34.555756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:34.622137 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:34.630820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1ab1da1f-f79a-4c09-b8d8-0f7d10f309ee tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.096838 Aug 09 12:58:34.631384 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1184/2366] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:34 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:35.185941 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:35.186787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:35.196596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:35.197071 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:35.197495 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:35.198181 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:35.198623 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:35.199039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:35.267406 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:35.275584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d76b7345-70f5-4470-bcea-fcae4a13b0fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096377 Aug 09 12:58:35.276181 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1183/2367] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:35 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:35.655824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:35.656764 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:35.666694 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:35.667172 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:35.667601 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:35.668287 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:35.668767 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:35.669185 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:35.741529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:35.753138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-32f8fe26-ae30-4cad-a088-f53b43c78e1e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.103204 Aug 09 12:58:35.754107 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1185/2368] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:35 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:36.305097 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:36.305703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:36.312591 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:36.313090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:36.313524 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:36.314223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:36.314667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:36.315082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:36.385992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:36.398548 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-bae8d460-1f34-44d3-829d-1daf260b7957 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096914 Aug 09 12:58:36.399519 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1184/2369] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:36 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:36.778965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:36.780028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:36.790810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:36.791615 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:36.792338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:36.793508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:36.794251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:36.794947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:36.814148 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:36.862449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:36.871149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-75ea8bad-cfff-4a28-9b21-81cfbd9dbee6 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.098909 Aug 09 12:58:36.871710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1186/2370] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:36 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:37.429523 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:37.430827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:37.441982 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:37.442783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:37.443493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:37.445009 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:37.445570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:37.445992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:37.513335 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:37.522919 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1f1c2a27-c2c0-418f-8f9b-cee7bfd2daf8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100359 Aug 09 12:58:37.523486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1185/2371] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:37 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:37.897853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:37.898621 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:37.908819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:37.909313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:37.909758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:37.910440 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:37.910886 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:37.911298 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:37.981422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:37.994200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b9f9cda8-f3fb-4819-9939-e37bc542fe84 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.102315 Aug 09 12:58:37.994913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1187/2372] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:37 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:38.547829 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:38.548902 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:38.557580 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:38.558069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:38.558506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:38.559191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:38.559640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:38.560058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:38.627613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:38.636170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7a3593d8-6666-45e8-91b7-783223581c26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094991 Aug 09 12:58:38.636771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1186/2373] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:38 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:39.019406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:39.020463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:39.030580 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:39.031062 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:39.031486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:39.032141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:39.032665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:39.033079 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:39.094658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:39.103068 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1c4fa01b-2702-4e26-964d-149e991ac20c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.090271 Aug 09 12:58:39.103605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1188/2374] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:39 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:39.661197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:39.661811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:39.668920 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:39.669408 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:39.669846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:39.670536 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:39.671093 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:39.671516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:39.736034 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:39.744184 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4dc85c22-0c47-4102-bf01-6d51c31555e2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089054 Aug 09 12:58:39.744810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1187/2375] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:39 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:40.128098 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:40.129203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:40.140125 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:40.140645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:40.141081 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:40.141776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:40.142222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:40.142639 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:40.218643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:40.226735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e4f286b4-dec6-415b-bd11-d8ac70ac70a5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.105680 Aug 09 12:58:40.227307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1189/2376] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:40 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:40.770235 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:40.771241 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:40.782159 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:40.782862 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:40.783570 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:40.784759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:40.785505 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:40.786203 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:40.856220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:40.864264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cb16a8b7-8b43-44ab-9c86-09b341f8f3d9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101126 Aug 09 12:58:40.864859 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1188/2377] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:40 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:41.247401 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:41.248698 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:41.258336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:41.258991 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:41.259562 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:41.260670 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:41.261280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:41.261838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:41.332853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:41.340959 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7c2c8784-a733-4877-bd45-54dbb536aa34 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.097501 Aug 09 12:58:41.341551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1190/2378] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:41 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:41.892144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:41.892144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:41.902969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:41.903771 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:41.904543 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:41.905696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:41.906155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:41.906583 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:41.978459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:41.990575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dfc0c31f-9797-488e-8610-554379b3837e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.106931 Aug 09 12:58:41.991412 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1189/2379] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:41 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:42.365585 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:42.366452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:42.377406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:42.378169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:42.378870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:42.379993 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:42.380841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:42.381531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:42.450324 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:42.458855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7fb1af2a-9a7f-4909-91cc-40653b2ad125 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.100280 Aug 09 12:58:42.459419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1191/2380] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:42 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:43.016117 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:43.016851 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:43.024260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:43.024860 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:43.025364 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:43.026163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:43.026687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:43.027176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:43.090440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:43.098338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f8099878-952c-4b39-8b11-586b2e98b787 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088628 Aug 09 12:58:43.098899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1190/2381] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:43 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:43.484165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:43.485142 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:43.495984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:43.496856 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:43.497582 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:43.498740 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:43.499441 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:43.500201 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:43.573405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:43.581777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7e2e9915-1367-4287-bec6-41005a0e032e tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.104541 Aug 09 12:58:43.582367 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1192/2382] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:43 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:44.122957 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:44.124174 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:44.131932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:44.132462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:44.132898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:44.133634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:44.134118 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:44.134565 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:44.198231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:44.206191 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-76c08881-ede5-4091-b413-e10b04cfe342 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089848 Aug 09 12:58:44.206747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1191/2383] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:44 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:44.606523 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:44.607453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:44.610671 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=54 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:44.616220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:44.616894 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:44.617307 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:44.617995 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:44.618447 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:44.618865 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:44.689882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:44.698157 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-dc790928-8672-4ee5-914b-6275e22512b5 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.097733 Aug 09 12:58:44.698735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1193/2384] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:44 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:45.231205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:45.232061 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:45.239521 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:45.240003 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:45.240424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:45.241140 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:45.241581 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:45.241997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:45.314245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:45.322624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4dea3435-66a4-47ca-85b6-f335b3445899 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097844 Aug 09 12:58:45.323266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1192/2385] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:45 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:45.596938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:58:45.597295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 12:58:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:58:45.720309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:45.721050 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:45.728516 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:45.729003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:45.729428 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:45.730145 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:45.730616 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:45.731028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:45.794923 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:45.803215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6eb4910b-2f23-45b2-952d-f432e8a42955 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.087673 Aug 09 12:58:45.803780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1194/2386] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:45 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:46.346099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:46.346701 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:46.353651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:46.354127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:46.354553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:46.355233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:46.355676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:46.356096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:46.358686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:46.428057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:46.438537 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b4df22b2-d32d-4df4-87f8-800c6f5dafae tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097288 Aug 09 12:58:46.439111 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1193/2387] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:46 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:46.829070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:46.829691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:46.837089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:46.837574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:46.838005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:46.838699 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:46.839158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:46.839571 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:46.912100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:46.923942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d380d586-ef66-4859-947a-d56333ccd348 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.100862 Aug 09 12:58:46.924544 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1195/2388] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:46 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:47.464048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:47.465086 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:47.476355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:47.477206 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:47.477888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:47.479087 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:47.479833 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:47.480577 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:47.544414 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:47.553095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-19261afc-fb97-4fe8-8c73-62371a34f13b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095678 Aug 09 12:58:47.553662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1194/2389] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:47 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:47.954960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:47.955720 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:47.966374 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:47.966898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:47.967398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:47.968424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:47.969356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:47.969735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:48.034330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:48.042805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e54b1461-1ccd-47cb-8212-b140d9e8dd9d tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.094705 Aug 09 12:58:48.043377 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1196/2390] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:47 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:48.574676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:48.575393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:48.577986 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=54 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:48.584028 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:48.584597 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:48.585095 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:48.585868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:48.586372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:48.586847 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:48.652641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:48.661146 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e3cb0384-e229-4a99-8cc2-5668a0f959a7 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090855 Aug 09 12:58:48.661706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1195/2391] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:48 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:49.068101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:49.069160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:49.080430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:49.080952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:49.081395 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:49.082091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:49.082542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:49.082963 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:49.159586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:49.170878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5f9a3c80-6c9b-4988-9999-fceba2fd562f tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.109966 Aug 09 12:58:49.171689 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1197/2392] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:49 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:49.687209 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:49.688169 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:49.696825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:49.697303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:49.697729 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:49.698405 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:49.698881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:49.699296 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:49.771529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:49.779477 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-adf125c5-21f8-4685-85cd-eb1b9fc0e048 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098822 Aug 09 12:58:49.780054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1196/2393] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:49 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:50.198841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:50.199797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:50.210276 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:50.210771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:50.211190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:50.211882 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:50.212331 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:50.212785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:50.276425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:50.284853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-14a2062c-50d4-4496-9ce6-e3ea3734adb4 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.092996 Aug 09 12:58:50.285446 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1198/2394] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:50 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:50.804073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:50.804730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:50.812744 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:50.813309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:50.813815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:50.814615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:50.815143 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:50.815637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:50.882250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:50.890336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7d4bbef4-7fe1-485e-9654-04c6aeb508cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093000 Aug 09 12:58:50.890882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1197/2395] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:50 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:51.315035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:51.315808 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:51.324369 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:51.324869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:51.325299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:51.325982 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:51.326430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:51.326850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:51.397442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:51.405868 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-74005ccf-95d9-4c0d-8cd0-a6ec29354e92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.096058 Aug 09 12:58:51.406455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1199/2396] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:51 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:51.915010 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:51.915646 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:51.922462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:51.922945 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:51.923381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:51.924074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:51.924563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:51.924987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:51.986090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:51.993653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-535c02fc-dda5-4ed7-97cd-21d49c84bd96 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.083858 Aug 09 12:58:51.994183 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1198/2397] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:51 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:52.334275 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:58:52.334486 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 12:58:52.437069 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:52.438066 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:52.449070 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:52.449874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:52.450541 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:52.451785 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:52.452577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:52.453284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:52.526889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:52.539018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-79c3ca47-9b98-46c3-a0bb-deed31e4fcf9 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.108367 Aug 09 12:58:52.539788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1200/2398] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:52 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:53.019045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:53.020032 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:53.028717 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:53.029202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:53.029633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:53.030317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:53.030765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:53.031187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:53.100185 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:53.108366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-931eef05-acee-4d4f-8615-8e93105250d2 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096007 Aug 09 12:58:53.108956 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1199/2399] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:53 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:53.564004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:53.565101 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:53.574399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:53.574883 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:53.575314 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:53.576004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:53.576486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:53.576907 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:53.644732 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:53.653388 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-73dfaa76-1087-48cf-8e07-260ce611eb76 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.095883 Aug 09 12:58:53.653986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1201/2400] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:53 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:54.131245 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:54.131840 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:54.139244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:54.139772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:54.140223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:54.141018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:54.141402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:54.141822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:54.213336 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:54.221048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-96353f75-477d-4002-b06d-e9c5fa348716 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093848 Aug 09 12:58:54.221603 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1200/2401] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:54 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:54.678518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:54.679535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:54.687503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:54.687984 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:54.688408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:54.689134 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:54.689581 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:54.690004 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:54.754706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:54.763746 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ebd940ae-370a-405e-aa43-a1e1d4e7c93c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.091808 Aug 09 12:58:54.764313 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1202/2402] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:54 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:55.245898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:55.246553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:55.254753 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:55.255314 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:55.255818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:55.256659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:55.257186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:55.257677 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:55.328127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:55.338888 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ebf5e06b-4811-4b5b-b3a8-d98c2261ff49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098929 Aug 09 12:58:55.339440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1201/2403] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:55 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:55.784822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:55.785408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:55.792835 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:55.793319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:55.793797 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:55.794493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:55.794964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:55.795382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:55.797960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:55.871235 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:55.880284 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4bd1fc5d-2bf5-4e5a-bcdb-f7d317d69990 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.099375 Aug 09 12:58:55.881000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1203/2404] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:55 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:56.364244 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:56.365257 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:56.377055 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:56.377853 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:56.378573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:56.379696 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:56.380437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:56.381182 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:56.458638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:56.470397 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-97de1ef1-320d-4261-a856-2322fca30aeb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.112286 Aug 09 12:58:56.471098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1202/2405] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:56 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:56.903506 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:56.904116 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:56.910940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:56.911451 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:56.911899 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:56.912618 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:56.913065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:56.913486 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:56.976722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:56.986000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-caf14512-01e8-49b0-95cf-f5beb4c94696 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.086936 Aug 09 12:58:56.986638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1204/2406] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:56 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:57.495814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:57.496802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:57.505017 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:57.505613 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:57.506124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:57.506939 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:57.507459 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:57.507948 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:57.573313 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:57.581151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ae985c63-16e0-4b12-8c3f-907cdcd6b68b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091879 Aug 09 12:58:57.581699 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1203/2407] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:57 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:58.012158 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:58.012917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:58.020838 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:58.021406 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:58.021916 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:58.022721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:58.023250 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:58.023758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:58.097222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:58.110118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f6627319-7dbf-441f-ac73-89e54c5b0c92 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.103911 Aug 09 12:58:58.110918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1205/2408] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:58 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:58.605749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:58.606511 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:58.613195 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:58.613672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:58.614099 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:58.614772 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:58.615217 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:58.615629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:58.684743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:58.692651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1bcdb524-64c3-4067-96f5-a6621641c357 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093821 Aug 09 12:58:58.693202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1204/2409] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:58 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:59.136319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:59.137743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:59.148818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:59.149525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:59.150232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:59.151352 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:59.152271 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:59.152727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:59.215274 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:59.223627 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-23dcb980-3a5d-4813-a584-658e2626da05 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.094169 Aug 09 12:58:59.224246 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1206/2410] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:59 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:58:59.717166 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:58:59.717793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:58:59.725441 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:59.725973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:59.726446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:59.727202 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:58:59.727698 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:58:59.728154 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:58:59.801303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:58:59.809436 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a3c02df-e74f-4823-9497-dd83f26ebe8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097983 Aug 09 12:58:59.810024 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1205/2411] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:58:59 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:00.244215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:00.244862 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:00.252117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:00.252641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:00.253078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:00.253799 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:00.254254 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:00.254679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:00.328509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:00.336707 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6caf8395-fa71-4a3a-b485-a6bfebc4e4f7 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.096463 Aug 09 12:59:00.337278 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1207/2412] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:00 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:00.834745 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:00.835602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:00.847338 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:00.848134 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:00.848907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:00.850058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:00.850810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:00.851560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:00.918568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:00.927165 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0aa5f80-5202-4822-863b-0f68c362d736 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099206 Aug 09 12:59:00.927765 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1206/2413] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:00 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:01.363836 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:01.364986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:01.376978 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:01.377641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:01.378256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:01.379351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:01.379935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:01.380503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:01.449855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:01.458837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-55bb14ab-1cae-4da9-96ad-4485f1874e28 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.103239 Aug 09 12:59:01.459420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1208/2414] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:01 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:01.953498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:01.954333 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:01.965098 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:01.965912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:01.966629 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:01.967837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:01.968293 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:01.968750 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:02.042540 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:02.054379 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b300565c-ab5e-4750-87ba-b0c3f0880beb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.107933 Aug 09 12:59:02.055175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1207/2415] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:01 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:02.483336 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:02.483892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:02.490761 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:02.491244 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:02.491679 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:02.492368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:02.492855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:02.493276 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:02.561415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:02.569814 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0e9f3e67-40d7-499b-bed2-d181dc633886 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.092916 Aug 09 12:59:02.570372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1209/2416] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:02 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:03.079646 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:03.080435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:03.089176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:03.089811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:03.090383 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:03.091290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:03.091881 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:03.092732 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:03.159775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:03.171630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-f9565a4b-6b57-4013-ab2e-bd7098864c4c tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098780 Aug 09 12:59:03.172197 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1208/2417] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:03 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:03.594452 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:03.595071 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:03.604449 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:03.605136 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:03.605701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:03.606725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:03.607413 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:03.607921 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:03.683706 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:03.691796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1e7d3b77-b290-4e11-a09e-d6357d14323c tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.103546 Aug 09 12:59:03.692407 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1210/2418] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:03 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:04.194764 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:04.195402 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:04.204668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:04.205276 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:04.205815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:04.206694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:04.207246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:04.207747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:04.296630 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:04.300119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=100 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:04.310573 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c1b6f597-80e0-4167-9267-dd12a6c04826 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.120188 Aug 09 12:59:04.311529 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1209/2419] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:04 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:04.717000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:04.718387 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:04.724693 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:04.725175 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:04.725611 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:04.726294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:04.726744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:04.727165 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:04.791188 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:04.799969 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4af21fbe-6438-4f53-8718-f49797727b79 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.089472 Aug 09 12:59:04.800499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1211/2420] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:04 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:05.338282 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:05.339327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:05.350975 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:05.351783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:05.352558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:05.353694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:05.354455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:05.355163 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:05.418625 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:05.426659 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-49f0d2f0-9c11-4dfd-a91c-13e9af173f80 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095437 Aug 09 12:59:05.427221 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1210/2421] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:05 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:05.829243 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:05.829946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:05.838283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:05.838891 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:05.839425 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:05.840283 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:05.840887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:05.841414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:05.903121 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:05.911628 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-abdf6d4c-98ea-467f-ac61-bec133426efb tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.087390 Aug 09 12:59:05.912197 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1212/2422] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:05 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:06.450978 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:06.452200 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:06.462925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:06.463710 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:06.464461 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:06.465619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:06.466361 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:06.467075 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:06.531656 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:06.539326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-c398e9a2-56dd-4dba-a36a-3c86196f57d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094886 Aug 09 12:59:06.539870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1211/2423] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:06 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:06.932117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:06.932831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:06.940222 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:06.940791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:06.941305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:06.942019 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:06.942780 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:06.943215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:07.018104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:07.030351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f7bfab15-a4a3-4daf-9132-aa15247c47af tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.102509 Aug 09 12:59:07.031003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1213/2424] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:06 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:07.565084 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:07.565984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:07.577243 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:07.577768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:07.578128 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:07.578815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:07.579260 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:07.579661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:07.651673 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:07.659868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e2cf01fd-7309-43cf-a0ca-74d1f0851456 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101819 Aug 09 12:59:07.660544 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1212/2425] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:07 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:08.055368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:08.056329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:08.065032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:08.065518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:08.065964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:08.066658 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:08.067111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:08.067534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:08.129269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:08.137359 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-255d5c0c-08ad-489c-903e-bdbb6dd07b25 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.088408 Aug 09 12:59:08.137953 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1214/2426] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:08 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:08.687151 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:08.687730 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:08.694747 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:08.695265 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:08.695692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:08.696415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:08.696908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:08.697355 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:08.759458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:08.767460 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-900a8168-e892-4c4f-a999-368457c216a3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.086142 Aug 09 12:59:08.768026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1213/2427] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:08 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:09.163026 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:09.163871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:09.173513 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:09.174000 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:09.174432 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:09.175209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:09.175209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:09.175209 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:09.240089 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:09.248402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-244b2dea-b17c-49c3-a02a-d76eca3e3861 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.092371 Aug 09 12:59:09.249215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1215/2428] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:09 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:09.792908 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:09.793868 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:09.801401 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:09.801875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:09.802301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:09.802984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:09.803428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:09.803869 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:09.868407 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:09.876678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6ff75bd2-970b-4997-ab01-22241708a722 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090231 Aug 09 12:59:09.877230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1214/2429] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:09 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:10.318150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:10.318756 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] [instance: 6409e8d1-b827-4649-83ea-b853a1f203ff] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:10.325572 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:10.326048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:10.326477 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:10.327269 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:10.327716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:10.328132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:10.402491 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6c4f7d2e6e42b38368cf3eaffc6187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57ead005fcd46e4a751225d11d4f9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:10.410784 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-be4c19df-2987-4b33-b528-6a6f1176d646 tempest-VolumesSnapshotTestJSON-1259384910 tempest-VolumesSnapshotTestJSON-1259384910-project] 10.222.0.60 "GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff" status: 200 len: 1349 microversion: 2.1 time: 0.144796 Aug 09 12:59:10.411358 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1216/2430] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:10 2022] GET /compute/v2.1/servers/6409e8d1-b827-4649-83ea-b853a1f203ff => generated 1349 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:10.902073 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:10.903219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:10.911475 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:10.911958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:10.912421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:10.913116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:10.913568 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:10.913987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:10.976249 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:10.984620 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-878275e8-e674-4311-aa4f-c11dc8849614 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089150 Aug 09 12:59:10.985190 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1215/2431] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:10 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:12.010412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:12.011430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:12.019874 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:12.020415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:12.020870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:12.021557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:12.022009 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:12.022427 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:12.099574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:12.107777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3aa253c1-1736-4861-b005-f7bed0521b56 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.103916 Aug 09 12:59:12.109044 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1217/2432] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:12 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:13.139563 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:13.140898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:13.151485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:13.152340 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:13.153116 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:13.154264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:13.155026 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:13.155816 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:13.229343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:13.237467 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1954615b-bdf9-4c41-b9b9-f6e09cc1afab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.104620 Aug 09 12:59:13.238066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1216/2433] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:13 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:14.263087 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:14.264048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:14.272203 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:14.272713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:14.273184 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:14.273918 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:14.274368 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:14.274847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:14.344539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:14.352504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-308702fe-9ff6-4815-ac63-ce98a6119e52 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096100 Aug 09 12:59:14.353059 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1218/2434] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:14 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:15.373716 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:15.374349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:15.381567 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:15.382053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:15.382493 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:15.383189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:15.383638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:15.384062 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:15.388615 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 12:59:15.388794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 12:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 (ip 10.222.0.60) !!! Aug 09 12:59:15.450607 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:15.458494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fa68698f-cc7f-433c-b7fc-fb8c9adaf522 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088732 Aug 09 12:59:15.459054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1217/2435] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:15 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:16.482090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:16.482867 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:16.485934 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=52 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:16.492262 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:16.492777 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:16.493215 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:16.493892 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:16.494343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:16.494772 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:16.567802 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:16.570029 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=100 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:16.576789 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-01840482-00e5-4aee-b076-4e6b486811f9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099932 Aug 09 12:59:16.577370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1219/2436] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:16 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:17.601857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:17.602959 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:17.614240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:17.615181 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:17.615940 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:17.617141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:17.617889 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:17.618558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:17.688987 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:17.697380 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9f940d66-4998-4573-a22e-f683e60b49ef tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102196 Aug 09 12:59:17.697951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1218/2437] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:17 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:18.720946 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:18.721848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:18.728853 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:18.729339 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:18.729766 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:18.730459 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:18.731018 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:18.731463 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:18.807186 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:18.818551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b66f6e7a-a9f5-4bfc-8d0c-2452baffc5df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102893 Aug 09 12:59:18.819092 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1220/2438] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:18 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:19.841639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:19.842558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:19.847164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=48 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:19.852048 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:19.852564 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:19.852995 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:19.853990 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:19.854447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:19.854870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:19.917854 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:19.925708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-316d084b-5dd3-4f1b-832f-798cb49b0da8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089987 Aug 09 12:59:19.926266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1219/2439] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:19 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:20.950704 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:20.951306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:20.957958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:20.958496 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:20.958900 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:20.959597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:20.960048 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:20.960498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:21.031551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:21.039771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-862b2269-f75b-44a0-9f9e-df3b9605e211 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093541 Aug 09 12:59:21.040414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1221/2440] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:20 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:22.071238 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:22.072193 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:22.079145 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:22.079628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:22.080058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:22.080775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:22.081223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:22.081638 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:22.142494 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:22.150624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8d91ecea-7bc2-4ad5-8e31-c9dce7a36943 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.085540 Aug 09 12:59:22.151186 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1220/2441] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:22 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:23.171022 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:23.171567 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:23.178419 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:23.178898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:23.179326 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:23.180006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:23.180482 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:23.180904 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:23.244330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:23.253060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-e2a02b51-6e8a-499c-917d-cb388c8ab8cd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.086061 Aug 09 12:59:23.253629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1222/2442] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:23 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:24.278156 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:24.279141 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:24.289739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:24.290534 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:24.291144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:24.291897 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:24.292341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:24.292783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:24.361426 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:24.372616 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-65b488e5-fb02-44ce-b944-942275d69b09 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101188 Aug 09 12:59:24.373230 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1221/2443] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:24 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:25.395948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:25.396691 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:25.404325 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:25.404901 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:25.405329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:25.406012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:25.406456 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:25.406871 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:25.475636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:25.483893 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-edde0a92-1c94-47d7-a6a7-a299c2b8ac17 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092534 Aug 09 12:59:25.484481 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1223/2444] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:25 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:26.516935 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:26.517981 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:26.528973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:26.529725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:26.530434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:26.531598 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:26.532310 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:26.533056 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:26.599068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:26.606985 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0253a65-e1e9-4a69-b345-146de16f028b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096957 Aug 09 12:59:26.607559 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1222/2445] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:26 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:27.632669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:27.633697 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:27.644909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:27.645716 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:27.646501 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:27.647649 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:27.648461 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:27.649169 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:27.718380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:27.729223 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0c1b670f-165f-40c1-985b-a3a4e75a0103 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.103246 Aug 09 12:59:27.729819 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1224/2446] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:27 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:28.754787 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:28.755780 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:28.765418 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:28.765971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:28.766462 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:28.767458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:28.768211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:28.769072 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:28.838053 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:28.845980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ddbc053-6192-4196-b218-5e63f6dfdfa9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098135 Aug 09 12:59:28.846538 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1223/2447] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:28 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:29.870551 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:29.871100 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:29.878159 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:29.879141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:29.879141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:29.879734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:29.880180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:29.880667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:29.948450 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:29.956634 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-94245127-cd2b-4a2e-b603-4da5972fb171 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091656 Aug 09 12:59:29.957204 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1225/2448] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:29 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:30.980001 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:30.980628 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:30.987393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:30.987857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:30.988298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:30.989013 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:30.989463 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:30.989880 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:31.052641 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:31.063926 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27d7ff57-3228-4b89-b96b-cdfd744ac876 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088774 Aug 09 12:59:31.064715 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1224/2449] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:30 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:32.089245 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:32.089955 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:32.097602 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:32.098160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:32.098667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:32.099469 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:32.099999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:32.100527 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:32.173371 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:32.184196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bfa18a5f-ab8d-4581-9160-17baf61b9380 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101812 Aug 09 12:59:32.184798 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1226/2450] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:32 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:33.207488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:33.208219 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:33.217352 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:33.217984 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:33.218562 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:33.219480 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:33.220088 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:33.220708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:33.284721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:33.292651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b894e64f-8aab-4d32-af6f-c92787b50941 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090515 Aug 09 12:59:33.293220 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1225/2451] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:33 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:34.316886 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:34.317879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:34.328988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:34.329794 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:34.330518 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:34.331665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:34.332442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:34.333180 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:34.403553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:34.419986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-a83dd0d6-b176-4a51-b559-042641f4fcba tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.109005 Aug 09 12:59:34.421335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1227/2452] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:34 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:35.453806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:35.454382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:35.461788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:35.462266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:35.462695 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:35.463482 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:35.463925 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:35.464343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:35.466961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=98 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:35.534092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:35.542090 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-938a417f-6a2c-4398-aa30-9cc253fea586 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092114 Aug 09 12:59:35.542643 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1226/2453] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:35 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:36.567566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:36.568154 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:36.579733 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:36.580553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:36.581280 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:36.582422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:36.583173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:36.583914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:36.651227 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:36.658758 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1d844832-c57d-4091-9788-b8b32e5bb9cb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098271 Aug 09 12:59:36.659335 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1228/2454] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:36 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:37.684176 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:37.685065 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:37.696150 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:37.697031 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:37.697756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:37.698446 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:37.698896 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:37.699322 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:37.772815 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:37.785539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7b6fe473-bfed-4300-aa93-1d3f14d0f071 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.107765 Aug 09 12:59:37.786491 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1227/2455] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:37 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:38.811817 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:38.812647 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:38.821372 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:38.822011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:38.822617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:38.823526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:38.824118 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:38.824710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:38.891824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:38.899398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-9e2c35d6-795f-4516-8d0f-052417cf28af tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093063 Aug 09 12:59:38.899942 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1229/2456] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:38 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:39.921871 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:39.922469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:39.929365 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:39.929875 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:39.930299 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:39.930983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:39.931429 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:39.931863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:39.993664 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:40.001754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a2f0222e-6d0b-423b-b6e3-037e80d214a8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.083893 Aug 09 12:59:40.002298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1228/2457] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:39 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:41.026309 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:41.027105 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:41.035479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:41.036076 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:41.036665 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:41.037549 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:41.038117 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:41.038643 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:41.105238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:41.112875 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-47ed71af-0fb1-4ccd-84d0-1f4d3580ce26 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093325 Aug 09 12:59:41.113435 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1230/2458] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:41 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:42.136512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:42.137119 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:42.144420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:42.144867 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:42.145315 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:42.146066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:42.146560 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:42.147027 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:42.215814 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:42.223499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9beaed50-5cfe-4bac-b237-2fc8c2395fca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092726 Aug 09 12:59:42.224076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1229/2459] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:42 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:43.248035 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:43.248791 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:43.257455 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:43.258095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:43.258667 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:43.259553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:43.260645 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:43.261534 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:43.330842 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:43.341164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-b9c4a8d4-ad45-4a91-9a80-f18a968113c3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099802 Aug 09 12:59:43.341728 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1231/2460] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:43 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:44.366655 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:44.367675 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:44.378376 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:44.379170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:44.379909 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:44.381080 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:44.381828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:44.382741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:44.457208 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:44.464887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-cf8e882a-eac0-4f39-887e-a941ddbb6a49 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.104828 Aug 09 12:59:44.465434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1230/2461] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:44 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:45.489890 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:45.490851 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:45.498877 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:45.499674 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:45.500103 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:45.500825 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:45.501268 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:45.501683 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:45.563176 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:45.571289 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-1b00593d-1d8b-43a1-9e1b-2066dd3c4101 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088050 Aug 09 12:59:45.571864 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1232/2462] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:45 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:46.594811 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:46.595506 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:46.605498 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:46.605983 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:46.606417 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:46.607103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:46.607554 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:46.607973 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:46.673277 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:46.681450 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-44a29932-3686-46c4-b716-31e925b5e707 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093566 Aug 09 12:59:46.682783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1231/2463] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:46 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:47.706560 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:47.707540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:47.711198 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=28 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:47.717405 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:47.717879 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:47.718305 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:47.718986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:47.719426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:47.719841 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:47.791095 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:47.800837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bf3b47d2-5eaa-4330-954c-260665c898cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100609 Aug 09 12:59:47.801664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1233/2464] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:47 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:48.826650 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:48.827619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:48.839014 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:48.839822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:48.840606 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:48.841741 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:48.842584 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:48.843292 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:48.911837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:48.920096 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-67f878ec-ea95-4670-857f-ee7ff6a20324 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100459 Aug 09 12:59:48.920690 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1232/2465] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:48 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:49.942414 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:49.943064 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:49.951282 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:49.951769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:49.952200 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:49.952931 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:49.953380 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:49.953804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:49.956320 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=86 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:50.019533 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:50.027850 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-99341d37-a3ef-4e5f-8353-8948557338bc tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089590 Aug 09 12:59:50.028424 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1234/2466] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:49 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:51.052998 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:51.054060 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:51.057950 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=28 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:51.067330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:51.068132 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:51.068899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:51.070045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:51.070802 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:51.071497 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:51.134827 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:51.142731 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-74354e33-ec04-4db5-9851-4d4b24b67966 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096398 Aug 09 12:59:51.143227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1233/2467] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:51 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:52.168605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:52.169474 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:52.180598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:52.181408 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:52.182216 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:52.182919 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:52.183370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:52.183793 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:52.250167 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:52.257948 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c3815579-34ed-420c-a0de-afe6d0f2a015 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096300 Aug 09 12:59:52.258554 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1235/2468] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:52 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:53.283329 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:53.284624 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:53.295326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:53.296127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:53.296915 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:53.298050 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:53.298803 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:53.299512 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:53.364231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:53.372864 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-be4b4932-f231-44c4-b9a3-0730f9341d15 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095400 Aug 09 12:59:53.373449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1234/2469] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:53 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:54.398102 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:54.399111 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:54.410389 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:54.411173 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:54.411884 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:54.413051 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:54.413810 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:54.414547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:54.491952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:54.503434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2781efa2-9494-421f-9fe5-abc6a1804a00 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.111544 Aug 09 12:59:54.504143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1236/2470] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:54 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:55.530922 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:55.531640 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:55.540139 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:55.540773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:55.541309 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:55.542155 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:55.542720 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:55.543239 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:55.615510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:55.626250 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ead2d511-3c6b-430d-837e-63c128bc7c5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101171 Aug 09 12:59:55.626824 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1235/2471] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:55 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:56.651078 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:56.651872 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:56.662795 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:56.663473 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:56.664149 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:56.665174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:56.665752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:56.666478 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:56.748750 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:56.757342 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-af0a2fe7-1227-4da6-bee9-298226bf32c5 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.113050 Aug 09 12:59:56.758950 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1237/2472] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:56 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:57.782705 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:57.783866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:57.790846 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:57.791325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:57.791749 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:57.792428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:57.792903 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:57.793317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:57.862288 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:57.870210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-56eb64a3-aec2-4148-b79f-f6640aa8e16b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094039 Aug 09 12:59:57.870775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1236/2473] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:57 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 12:59:58.891468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 12:59:58.892072 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 12:59:58.899304 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:58.899769 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:58.900196 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:58.900909 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 12:59:58.901356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 12:59:58.901771 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 12:59:58.965632 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 12:59:58.978128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2ce0b030-c347-48fe-9b50-6fd15ec3b9a4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090350 Aug 09 12:59:58.978866 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1238/2474] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:58 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:00.003825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:00.004594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:00.011177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:00.011657 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:00.012082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:00.012782 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:00.013233 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:00.013648 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:00.076261 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:00.084882 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3ef40064-ee73-4a23-8555-f4a07005009d tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087605 Aug 09 13:00:00.085442 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1237/2475] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 12:59:59 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:01.109263 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:01.110302 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:01.117788 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:01.118275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:01.118708 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:01.119397 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:01.119847 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:01.120299 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:01.184965 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:01.192800 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6417fc6b-aa90-4fc7-9e58-28808caeb44b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089931 Aug 09 13:00:01.193379 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1239/2476] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:01 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:02.217928 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:02.218806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:02.226575 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:02.227054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:02.227485 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:02.228170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:02.228651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:02.229068 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:02.299850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:02.307713 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fc0dd18d-22c3-49ad-be60-b6fe94935d95 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096396 Aug 09 13:00:02.308273 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1238/2477] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:02 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:03.332624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:03.333294 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:03.341150 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:03.341709 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:03.342214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:03.343012 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:03.343539 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:03.344007 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:03.407420 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:03.415576 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-0233c6f0-c43f-4d22-b968-e52b7a44941a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088911 Aug 09 13:00:03.416143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1240/2478] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:03 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:04.440440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:04.441127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:04.448687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:04.449224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:04.449706 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:04.450466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:04.450967 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:04.451437 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:04.514572 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:04.522552 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8a0b1b21-3e72-4240-a232-b514a2274930 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088330 Aug 09 13:00:04.523125 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1239/2479] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:04 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:05.545723 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:05.546494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:05.553957 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:05.554434 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:05.554863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:05.555531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:05.555999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:05.556411 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:05.621722 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:05.630205 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-43978102-32cd-4794-b7f5-cb439f90aeb8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089805 Aug 09 13:00:05.630820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1241/2480] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:05 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:06.654438 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:06.655427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:06.663488 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:06.663976 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:06.664420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:06.665122 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:06.665576 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:06.666000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:06.668558 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=84 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:00:06.727838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:06.735822 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1409db5e-675d-43dd-97bd-2483f46aba39 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087934 Aug 09 13:00:06.736442 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1240/2481] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:06 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:07.760650 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:07.761436 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:07.770833 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:07.771318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:07.771757 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:07.772495 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:07.772952 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:07.773382 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:07.836061 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:07.843787 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-89ef5412-302f-4c8e-b418-4fd5c44bcb29 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089621 Aug 09 13:00:07.844356 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1242/2482] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:07 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:08.869023 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:08.869968 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:08.879555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:08.880665 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:08.881104 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:08.881793 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:08.882270 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:08.882694 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:08.946321 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:08.958601 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-6a9facfd-e082-492e-9188-5fb3a4c6a960 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095972 Aug 09 13:00:08.959451 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1241/2483] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:08 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:09.986949 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:09.987594 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:09.994479 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:09.994962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:09.995394 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:09.996248 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:09.996737 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:09.997156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:10.063519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:10.071626 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f635df39-716f-4e5d-b42f-31f77e70b156 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090896 Aug 09 13:00:10.072183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1243/2484] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:09 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:11.093431 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:11.094030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:11.101327 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:11.101825 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:11.102267 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:11.102971 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:11.103424 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:11.104046 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:11.177223 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:11.185969 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a6340123-73e1-4f4c-8681-ef0cb5c595da tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096592 Aug 09 13:00:11.186555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1242/2485] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:11 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:12.213104 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:12.213958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:12.224855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:12.225682 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:12.226403 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:12.227532 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:12.228295 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:12.229132 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:12.297526 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:12.305971 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ab2bf8e4-db67-44f4-99c6-3193c390a938 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100350 Aug 09 13:00:12.306503 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1244/2486] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:12 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:13.331344 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:13.332932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:13.343147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:13.343931 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:13.344708 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:13.345837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:13.346585 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:13.347280 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:13.419800 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:13.431805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-a0458ae3-a44d-4dd1-a24e-20e0b5989aa8 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.106946 Aug 09 13:00:13.432496 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1243/2487] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:13 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:14.458164 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:14.459110 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:14.465763 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:14.466290 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:14.466724 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:14.467426 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:14.467878 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:14.468300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:14.540673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:14.548880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-4b37df8e-b1d4-4487-87f6-59f736f10241 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097223 Aug 09 13:00:14.549453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1245/2488] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:14 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:15.573691 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:15.574428 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:15.583283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:15.583913 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:15.584602 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:15.585660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:15.586259 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:15.586809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:15.654317 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:15.662064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-223dd191-1f52-4fd3-b669-930ae54418cf tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094751 Aug 09 13:00:15.662634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1244/2489] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:15 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:16.684099 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:16.684743 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:16.691321 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:16.691809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:16.692239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:16.692970 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:16.693423 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:16.693840 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:16.755178 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:16.763238 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-5d23a92e-9fc0-482f-98b2-fe2e523a1918 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.083132 Aug 09 13:00:16.763809 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1246/2490] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:16 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:17.787556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:17.788266 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:17.795303 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:17.795810 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:17.796264 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:17.797000 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:17.797458 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:17.797885 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:17.859828 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:17.868039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-e0eeca4b-a4c7-4d28-bf3f-6c26d7798b99 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087225 Aug 09 13:00:17.868676 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1245/2491] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:17 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:18.894042 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:18.894641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:18.897444 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=28 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:00:18.903727 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:18.904232 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:18.904664 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:18.905586 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:18.906190 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:18.906483 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:18.978296 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:18.992962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3491d9df-49d1-4f25-9bf6-82a598b563d0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.102859 Aug 09 13:00:18.993557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1247/2492] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:18 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:20.014943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:20.015592 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:20.025082 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:20.025878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:20.026343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:20.027092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:20.027687 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:20.028168 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:20.094703 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:20.104937 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-3c93e167-5ecb-4128-bb33-136a19194149 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094412 Aug 09 13:00:20.105759 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1246/2493] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:20 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:21.138011 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:21.138887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:21.148768 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:21.149251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:21.149684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:21.150353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:21.150796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:21.151211 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:21.153729 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=84 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:00:21.214940 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:21.222745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7b53f091-374b-4a0e-8ec6-72c21ab704b0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091750 Aug 09 13:00:21.223311 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1248/2494] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:21 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:22.247302 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:22.248211 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:22.252177 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=28 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:00:22.259368 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:22.259850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:22.260268 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:22.260955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:22.261400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:22.261813 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:22.323818 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:22.335092 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-dd048fb2-7d5e-4181-9de8-f12e01e7914e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094233 Aug 09 13:00:22.335842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1247/2495] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:22 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:23.358030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:23.358837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:23.367988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:23.368508 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:23.368944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:23.369636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:23.370091 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:23.370511 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:23.443752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:23.451939 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-cc3d7a37-9daa-47a8-868c-2f43f2fdac8f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099672 Aug 09 13:00:23.452617 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1249/2496] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:23 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:24.476307 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:24.476914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:24.483805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:24.484283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:24.484737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:24.485420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:24.485866 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:24.486284 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:24.548074 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:24.556054 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-9ba3012b-e7e6-4abc-bfbd-d8b931e6504a tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.085584 Aug 09 13:00:24.556662 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1248/2497] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:24 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:25.580725 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:25.581745 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:25.589759 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:25.590237 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:25.590668 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:25.591351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:25.591804 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:25.592219 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:25.656818 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:25.665057 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-213b74bf-6260-4980-850a-d32e660d5020 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090910 Aug 09 13:00:25.665642 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1250/2498] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:25 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:26.689612 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:26.690205 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:26.698301 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:26.698777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:26.699210 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:26.699899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:26.700346 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:26.700794 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:26.766872 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:26.775081 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7db412a9-8bff-4ff3-954e-758cdca1b415 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091604 Aug 09 13:00:26.775644 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1249/2499] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:26 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:27.799402 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:27.800310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:27.808824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:27.809306 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:27.809735 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:27.810421 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:27.810870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:27.811291 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:27.877073 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:27.888144 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-3422116c-1a91-4635-9451-7d5338207f10 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094566 Aug 09 13:00:27.888964 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1251/2500] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:27 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:28.914605 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:28.915382 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:28.922443 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:28.922912 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:28.923349 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:28.924047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:28.924530 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:28.924958 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:28.985692 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:28.993788 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b590cd3d-711c-466e-8bc8-195dba3e28e6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.084981 Aug 09 13:00:28.994348 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1250/2501] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:28 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:30.018568 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:30.019231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:30.028947 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:30.029422 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:30.029960 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:30.030897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:30.031498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:30.031930 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:30.100082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:30.107986 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c449e0cc-afb0-4e66-997c-bf00e4bae370 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095914 Aug 09 13:00:30.108574 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1252/2502] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:30 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:30.209991 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:00:30.210836 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:00:31.132686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:31.133286 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:31.140160 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:31.140668 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:31.141102 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:31.141837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:31.142218 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:31.142634 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:31.208645 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:31.217131 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-7655e1bf-d68e-438f-8ca0-0be362871fed tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090295 Aug 09 13:00:31.217685 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1251/2503] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:31 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:32.024636 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:00:32.025385 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:00:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:00:32.242499 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:32.243498 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:32.254692 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:32.255535 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:32.256214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:32.257292 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:32.257744 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:32.258160 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:32.322256 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:32.330174 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-489fbf47-3560-43fb-83e0-ab84869193fb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094213 Aug 09 13:00:32.330705 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1253/2504] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:32 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:33.354980 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:33.355739 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:33.365930 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:33.366421 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:33.366857 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:33.367553 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:33.368012 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:33.368533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:33.437393 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:33.447499 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-52c49088-647f-4707-b5af-b4892dfe7f84 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099041 Aug 09 13:00:33.448058 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1252/2505] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:33 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:34.472462 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:34.473471 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:34.480933 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:34.481415 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:34.481845 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:34.482536 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:34.482989 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:34.483412 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:34.545944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:34.554146 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-05fb0510-6127-484e-9d8f-0adb4ba6c6fe tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.088191 Aug 09 13:00:34.554715 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1254/2506] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:34 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:35.579224 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:35.580240 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:35.588734 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:35.589222 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:35.589642 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:35.590326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:35.590770 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:35.591187 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:35.653773 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:35.661737 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b8b8af46-cafd-42e0-92a1-22cadb679ea1 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089258 Aug 09 13:00:35.662455 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1253/2507] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:35 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:36.688082 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:36.689143 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:36.697547 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:36.698032 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:36.698459 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:36.699141 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:36.699583 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:36.699999 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:36.771550 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:36.779318 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-c6d5118f-ee80-4996-bd8b-35b906ddeb1f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097757 Aug 09 13:00:36.779848 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1255/2508] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:36 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:37.803415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:37.804039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:37.811114 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:37.811619 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:37.812035 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:37.812817 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:37.813287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:37.813724 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:37.816341 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=84 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:00:37.883398 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:37.893721 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ed179e64-3245-4e26-b33d-67b11ab36298 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096290 Aug 09 13:00:37.894542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1254/2509] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:37 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:38.919776 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:38.920677 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:38.929566 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:38.930332 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:38.931053 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:38.931917 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:38.932399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:38.932956 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:39.009183 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:39.017520 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-55fcd334-fa93-4630-b837-6e2bf2978f0f tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.104183 Aug 09 13:00:39.018086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1256/2510] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:38 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:40.039596 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:40.040263 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:40.046997 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:40.047473 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:40.047907 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:40.048660 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:40.049110 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:40.049528 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:40.128516 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:40.137120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-b5af29c3-186e-44fa-a36f-f24dde2a92b3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101541 Aug 09 13:00:40.137680 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1255/2511] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:40 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:41.162353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:41.162943 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:41.170531 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:41.171065 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:41.171546 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:41.172310 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:41.172846 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:41.173319 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:41.241820 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:41.253954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f06b9605-7cf0-4d46-85e1-723fc63d2ffb tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098089 Aug 09 13:00:41.254713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1257/2512] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:41 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:42.278723 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:42.279318 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:42.289006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:42.289487 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:42.289921 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:42.290600 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:42.291047 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:42.291466 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:42.353678 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:42.361768 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d219728d-b0dc-4726-8702-cf71bc3b88db tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089354 Aug 09 13:00:42.362594 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1256/2513] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:42 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:43.386805 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:43.387824 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:43.398168 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:43.398972 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:43.399731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:43.400869 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:43.401638 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:43.402345 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:43.469338 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:43.477156 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8f102c9d-44d3-491d-a762-ef3318d9d144 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097492 Aug 09 13:00:43.477717 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1258/2514] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:43 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:44.510124 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:44.511069 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:44.521587 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:44.522067 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:44.522542 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:44.523236 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:44.523697 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:44.524147 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:44.598179 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:44.610622 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-8211a693-cc07-4bf9-a593-9ee848b4ba07 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.107597 Aug 09 13:00:44.611331 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1257/2515] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:44 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:45.637494 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:45.638329 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:45.650084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:45.650880 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:45.651596 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:45.652816 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:45.653528 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:45.654229 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:45.732897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:45.740555 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-57aab6bd-ecb7-4084-8c2a-e3cfcc7934e4 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.110718 Aug 09 13:00:45.741128 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1259/2516] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:45 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:46.761725 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:46.762319 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:46.768898 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:46.769372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:46.769797 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:46.770469 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:46.771057 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:46.771440 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:46.843175 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:46.854661 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-27a2b9a9-0fb4-45a1-b3ee-476aed5c7066 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.096669 Aug 09 13:00:46.855453 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1258/2517] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:46 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:47.883876 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:47.884641 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:47.893013 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:47.893624 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:47.894166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:47.895034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:47.895631 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:47.896399 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:47.960300 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:47.968075 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-fedea8fe-b838-41a7-8ea2-93008ddccba0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.089984 Aug 09 13:00:47.968675 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1260/2518] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:47 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:47.973392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:00:47.973553 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:00:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:00:48.992039 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:48.992712 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:49.000283 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:49.000838 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:49.001311 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:49.002064 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:49.002556 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:49.003018 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:49.067452 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:49.085751 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-2d2d769c-172c-40cd-a641-48fc59d03dd0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.098938 Aug 09 13:00:49.086330 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1259/2519] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:48 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:50.110803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:50.111734 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:50.116255 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=28 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:00:50.133240 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:50.133721 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:50.134151 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:50.134837 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:50.135285 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:50.135701 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:50.205774 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:50.213938 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-f2ccd002-9a94-4bb7-9a23-f4a8735340a0 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.109647 Aug 09 13:00:50.214493 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1261/2520] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:50 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:51.238044 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:51.238658 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:51.245844 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:51.246323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:51.246775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:51.247434 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:51.247878 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:51.248290 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:51.317743 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:51.325865 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0837bf05-43eb-4950-8d2b-e38a9d8232ca tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093991 Aug 09 13:00:51.326395 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1260/2521] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:51 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:52.350684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:52.351398 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:52.359954 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:52.360605 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:52.361163 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:52.362028 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:52.362593 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:52.363126 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:52.366565 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=84 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:00:52.433710 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:52.441673 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-6f598064-5206-4696-9564-f77561f31359 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097250 Aug 09 13:00:52.442239 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1262/2522] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:52 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:53.465041 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:53.465842 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:53.468796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_api:SELECT=28 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:00:53.476170 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:53.476835 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:53.477400 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:53.478316 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:53.478914 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:53.479470 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:53.550030 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:53.559557 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-fb1c40a4-7a5c-4970-a1d8-8380e9ac69d6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.099821 Aug 09 13:00:53.560164 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1261/2523] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:53 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:54.584529 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:54.585507 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:54.596328 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:54.597192 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:54.597913 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:54.599086 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:54.599542 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:54.599962 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:54.677231 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:54.686958 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-48ee57dd-63a6-4a36-b39f-8947c4548ccd tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.108982 Aug 09 13:00:54.687525 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1263/2524] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:54 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:55.711042 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:55.711777 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:55.720036 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:55.720686 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:55.721227 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:55.722076 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:55.722637 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:55.723171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:55.791373 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:55.802863 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-749aaf72-cbb9-40ad-8f16-c907121b9f59 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.097523 Aug 09 13:00:55.803427 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1262/2525] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:55 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:56.827926 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:56.828898 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:56.838935 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:56.839726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:56.840442 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:56.841597 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:56.842350 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:56.843045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:56.906609 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:56.915123 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-d503d0ee-1b7e-45be-ab0f-474e8948beb6 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093650 Aug 09 13:00:56.915680 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1264/2526] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:56 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:57.940539 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:57.941532 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:57.952783 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:57.953627 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:57.954308 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:57.955420 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:57.956200 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:57.956951 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:58.017933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:58.026246 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0497834c-eae8-45e2-8298-acc8e0de1608 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092154 Aug 09 13:00:58.026808 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1263/2527] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:57 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:00:59.051281 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:00:59.052275 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:00:59.063084 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:59.063831 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:59.064654 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:59.065752 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:00:59.066598 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:00:59.067247 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:00:59.133870 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:00:59.145897 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-8a886d5b-34f1-4421-8a34-3f56e3eec256 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.100583 Aug 09 13:00:59.146622 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1265/2528] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:00:59 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:00.175415 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:00.176251 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:00.183435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:00.183916 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:00.184351 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:00.185079 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:00.185533 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:00.185961 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:00.255870 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:00.263850 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-d4473a69-1bab-4ee4-8121-f25ffab3a7de tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094994 Aug 09 13:01:00.264410 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1264/2529] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:00 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:01.284967 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:01.285557 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:01.292895 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:01.293370 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:01.293823 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:01.294540 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:01.294988 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:01.295404 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:01.365924 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:01.373803 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-bc8e463a-7f9f-49cd-9d46-3fb6dafd2a5e tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.092545 Aug 09 13:01:01.374364 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1266/2530] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:01 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:02.397403 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:02.397992 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:02.404839 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:02.405323 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:02.405754 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:02.406448 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:02.406899 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:02.407343 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:02.475672 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:02.483381 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-4e6a0135-bd82-41fe-8006-68a4bc51ef05 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.091863 Aug 09 13:01:02.483943 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1265/2531] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:02 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:03.506090 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:03.506684 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:03.513538 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:03.514030 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:03.514453 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:03.515131 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:03.515577 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:03.516052 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:03.581060 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:03.589214 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-2c689164-7dbe-41e1-8528-5e2561688542 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.087357 Aug 09 13:01:03.589781 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1267/2532] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:03 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:04.615447 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:04.616083 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:04.623891 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:04.624435 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:04.624932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:04.625682 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:04.626144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:04.626639 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:04.695449 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:04.703763 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-1328cf4a-34f7-48f2-bca3-7d381ecf9804 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.094769 Aug 09 13:01:04.704350 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1266/2533] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:04 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:05.725353 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:05.725944 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:05.732863 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:05.733351 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:05.733779 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:05.734468 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:05.734914 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:05.735330 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:05.803220 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:05.811138 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-7bf5a374-d7bf-40f7-a276-8c26ff82eb40 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.090039 Aug 09 13:01:05.811696 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1268/2534] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:05 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:06.835354 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:06.836127 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:06.845006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:06.845653 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:06.846231 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:06.847144 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:06.847748 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:06.848633 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:06.920963 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:06.924216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-754cd146-f1ae-4165-b1b4-15254a7640ab tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.095269 Aug 09 13:01:06.924821 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1267/2535] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:06 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:07.957858 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:07.959695 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:07.970509 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:07.971312 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:07.972034 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:07.973517 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:07.974373 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:07.974796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:08.040731 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.policy [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117661) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:08.052681 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-ba0c1d63-722c-44dd-b5d1-4ce174a1bd9b tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.101022 Aug 09 13:01:08.053504 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1269/2536] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:07 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:09.083326 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:09.084007 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: eeda6f80-e084-4b10-ae40-27df258a9d91] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:09.092037 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:09.092651 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:09.093162 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:09.093974 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:09.094508 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:09.095006 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:09.097999 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG dbcounter [-] [117660] Writing DB stats nova_cell1:SELECT=84 {{(pid=117660) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:01:09.162045 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.policy [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50fa6727271142eba979bb4562a2b853', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '602ad89c70da4ace9856766be19815a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117660) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 13:01:09.170216 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-0ca45167-e0eb-44b6-b93d-365bced124c9 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91" status: 200 len: 1225 microversion: 2.1 time: 0.093234 Aug 09 13:01:09.170779 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1268/2537] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:09 2022] GET /compute/v2.1/servers/eeda6f80-e084-4b10-ae40-27df258a9d91 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 13:01:09.647251 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:09.647778 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.compute.api [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117661) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:09.658033 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:09.658713 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:09.659323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:09.660343 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:09.661579 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:09.662003 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG oslo_concurrency.lockutils [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117661) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:09.683323 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.wsgi [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] HTTP exception thrown: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Request method failure captured: Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: request: DELETE /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 HTTP/1.1 Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept: application/json Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Accept-Encoding: identity Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Connection: close Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Length: 0 Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Content-Type: application/json Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Host: 10.222.0.60 Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Openstack-System-Scope: None Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: User-Agent: python-urllib3/1.26.11 Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Auth-Token: gAAAAABi8lJmmNztbTde0_SSYDZkHlOlKKRyyH8xhTaPeEQcl0zDncwHtVob8O0nOEllX3q1YoFPpndW5EnoSCehyS33kaBqlrir--u2jwnA0Jr1VUAhqdc_8iOKakjDdrGfYSnsSmWxkLAF61j0-PUaJ5bx67y-qVlROspImLwOZWLjxo_KN1w Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Id: None Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Domain-Name: None Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Identity-Status: Confirmed Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Is-Admin-Project: True Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Id: default Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Domain-Name: Default Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Id: 602ad89c70da4ace9856766be19815a5 Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Project-Name: tempest-TestVolumeBootPattern-1825304612 Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Role: member,reader Aug 09 13:01:09.686045 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Roles: member,reader Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/602ad89c70da4ace9856766be19815a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/602ad89c70da4ace9856766be19815a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_602ad89c70da4ace9856766be19815a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/602ad89c70da4ace9856766be19815a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant: tempest-TestVolumeBootPattern-1825304612 Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Id: 602ad89c70da4ace9856766be19815a5 Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-Tenant-Name: tempest-TestVolumeBootPattern-1825304612 Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User: tempest-TestVolumeBootPattern-1825304612-project Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Id: default Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Domain-Name: Default Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Id: 50fa6727271142eba979bb4562a2b853 Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: X-User-Name: tempest-TestVolumeBootPattern-1825304612-project Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: method: > Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: exception: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.688005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: action_args: {'id': '0c88f62f-d964-413d-a4be-e4f7341cabe9'} Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 13:01:09.689005 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.691006 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.692796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Returning 404 to user: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. {{(pid=117661) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 13:01:09.692796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-57330701-0886-4c73-b42b-acd4ee034a51 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "DELETE /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 404 len: 111 microversion: 2.1 time: 0.047683 Aug 09 13:01:09.692796 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1270/2538] 10.222.0.60 () {58 vars in 1239 bytes} [Tue Aug 9 13:01:09 2022] DELETE /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 13:01:09.698325 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '>' {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:01:09.698932 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.compute.api [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] [instance: 0c88f62f-d964-413d-a4be-e4f7341cabe9] Fetching instance by UUID {{(pid=117660) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 13:01:09.705298 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:09.705806 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:09.706242 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:09.706929 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Acquiring lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 13:01:09.707386 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 13:01:09.708366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG oslo_concurrency.lockutils [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Lock "e1582868-d229-4f3b-a98b-d87c6e368c3b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117660) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 13:01:09.726837 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.wsgi [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] HTTP exception thrown: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Request method failure captured: Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: request: GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 HTTP/1.1 Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept: application/json Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Accept-Encoding: identity Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Connection: close Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Length: 0 Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Content-Type: application/json Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Host: 10.222.0.60 Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Openstack-System-Scope: None Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: User-Agent: python-urllib3/1.26.11 Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Auth-Token: gAAAAABi8lJmmNztbTde0_SSYDZkHlOlKKRyyH8xhTaPeEQcl0zDncwHtVob8O0nOEllX3q1YoFPpndW5EnoSCehyS33kaBqlrir--u2jwnA0Jr1VUAhqdc_8iOKakjDdrGfYSnsSmWxkLAF61j0-PUaJ5bx67y-qVlROspImLwOZWLjxo_KN1w Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Id: None Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Domain-Name: None Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Identity-Status: Confirmed Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Is-Admin-Project: True Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Id: default Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Domain-Name: Default Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Id: 602ad89c70da4ace9856766be19815a5 Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Project-Name: tempest-TestVolumeBootPattern-1825304612 Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Role: member,reader Aug 09 13:01:09.728510 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Roles: member,reader Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/602ad89c70da4ace9856766be19815a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/602ad89c70da4ace9856766be19815a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_602ad89c70da4ace9856766be19815a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/602ad89c70da4ace9856766be19815a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}] Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant: tempest-TestVolumeBootPattern-1825304612 Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Id: 602ad89c70da4ace9856766be19815a5 Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-Tenant-Name: tempest-TestVolumeBootPattern-1825304612 Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User: tempest-TestVolumeBootPattern-1825304612-project Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Id: default Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Domain-Name: Default Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Id: 50fa6727271142eba979bb4562a2b853 Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: X-User-Name: tempest-TestVolumeBootPattern-1825304612-project Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: method: > Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: exception: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.729805 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: action_args: {'id': '0c88f62f-d964-413d-a4be-e4f7341cabe9'} Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: {{(pid=117660) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 13:01:09.730709 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. Aug 09 13:01:09.732555 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: ERROR nova.api.openstack.wsgi Aug 09 13:01:09.733775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: DEBUG nova.api.openstack.wsgi [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Returning 404 to user: Instance 0c88f62f-d964-413d-a4be-e4f7341cabe9 could not be found. {{(pid=117660) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 13:01:09.733775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO nova.api.openstack.requestlog [None req-ded4d835-51c8-46d0-b899-f551901fa8df tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9" status: 404 len: 111 microversion: 2.1 time: 0.035505 Aug 09 13:01:09.733775 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: [pid: 117660|app: 0|req: 1269/2539] 10.222.0.60 () {58 vars in 1236 bytes} [Tue Aug 9 13:01:09 2022] GET /compute/v2.1/servers/0c88f62f-d964-413d-a4be-e4f7341cabe9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 13:02:05.613475 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:02:05.614392 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:02:12.343890 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:02:12.344955 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:02:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:02:35.413103 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:02:35.414171 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:02:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:03:50.223887 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:03:50.224784 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:03:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:03:52.038278 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:03:52.039166 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:03:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:04:07.983127 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:04:07.983887 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:05:25.627607 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:05:25.628726 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:05:32.356762 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:05:32.357304 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:05:55.427120 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:05:55.428189 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:05:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:07:10.235924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:07:10.235924 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:07:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:07:11.788859 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bf71a9fe-b2b0-4e3d-800c-40cbc9b646de] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 13:07:11.789700 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_api:SELECT=19 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:11.790430 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG dbcounter [-] [117661] Writing DB stats nova_cell1:SELECT=49 {{(pid=117661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:11.794770 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: DEBUG nova.api.openstack.wsgi [None req-777daec5-9de7-4b73-82f0-e38b54fcaff3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] Calling method '.version_select at 0x7f0e0823b550>' {{(pid=117661) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 13:07:11.820889 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO nova.api.openstack.requestlog [None req-777daec5-9de7-4b73-82f0-e38b54fcaff3 tempest-TestVolumeBootPattern-1825304612 tempest-TestVolumeBootPattern-1825304612-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-898829135" status: 202 len: 0 microversion: 2.1 time: 0.033885 Aug 09 13:07:11.821467 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: [pid: 117661|app: 0|req: 1271/2540] 10.222.0.60 () {58 vars in 1260 bytes} [Tue Aug 9 13:07:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-898829135 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 13:07:12.051822 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:07:12.052021 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:07:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:07:27.996347 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:07:27.996992 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:07:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:08:52.365796 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:08:52.366756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:09:15.441287 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:09:15.441809 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:09:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:10:25.645629 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:10:25.646669 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:10:30.249756 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:10:30.250366 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:10:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:10:32.062855 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:10:32.063519 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:10:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:10:48.006755 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:10:48.007606 dv-cinder-852369-1-iscsi devstack@n-api.service[117661]: Tue Aug 9 13:10:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:12:12.379066 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:12:12.379933 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:12:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 13:12:35.451372 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 13:12:35.452667 dv-cinder-852369-1-iscsi devstack@n-api.service[117660]: Tue Aug 9 13:12:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!